-- Logs begin at Thu 2022-10-13 03:42:00 UTC, end at Thu 2022-10-13 04:22:29 UTC. -- Oct 13 04:07:30.240053 dv-cinder-860997-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 13 04:07:30.248677 dv-cinder-860997-1-smb devstack@keystone.service[81298]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 04:07:30 2022] *** Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: nodename: dv-cinder-860997-1-smb Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: machine: x86_64 Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: clock source: unix Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: pcre jit disabled Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: detected number of CPU cores: 4 Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: current working directory: / Oct 13 04:07:30.251229 dv-cinder-860997-1-smb devstack@keystone.service[81298]: detected binary path: /usr/bin/uwsgi-core Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: your processes number limit is 47680 Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: your memory page size is 4096 bytes Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: detected max file descriptor number: 2048 Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: lock engine: pthread robust mutexes Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: thunder lock: enabled Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 13 04:07:30.251794 dv-cinder-860997-1-smb devstack@keystone.service[81298]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 04:07:30.290037 dv-cinder-860997-1-smb devstack@keystone.service[81298]: Python main interpreter initialized at 0x55c6668859c0 Oct 13 04:07:30.290037 dv-cinder-860997-1-smb devstack@keystone.service[81298]: python threads support enabled Oct 13 04:07:30.290037 dv-cinder-860997-1-smb devstack@keystone.service[81298]: your server socket listen backlog is limited to 100 connections Oct 13 04:07:30.290037 dv-cinder-860997-1-smb devstack@keystone.service[81298]: your mercy for graceful operations on workers is 90 seconds Oct 13 04:07:30.290359 dv-cinder-860997-1-smb devstack@keystone.service[81298]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 04:07:30.290466 dv-cinder-860997-1-smb devstack@keystone.service[81298]: *** Operational MODE: preforking *** Oct 13 04:07:30.290731 dv-cinder-860997-1-smb devstack@keystone.service[81298]: *** uWSGI is running in multiple interpreter mode *** Oct 13 04:07:30.290731 dv-cinder-860997-1-smb devstack@keystone.service[81298]: spawned uWSGI master process (pid: 81298) Oct 13 04:07:30.290923 dv-cinder-860997-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 13 04:07:30.293087 dv-cinder-860997-1-smb devstack@keystone.service[81298]: spawned uWSGI worker 1 (pid: 81310, cores: 1) Oct 13 04:07:30.293087 dv-cinder-860997-1-smb devstack@keystone.service[81298]: spawned uWSGI worker 2 (pid: 81311, cores: 1) Oct 13 04:07:30.293087 dv-cinder-860997-1-smb devstack@keystone.service[81298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 04:07:34.543214 dv-cinder-860997-1-smb devstack@keystone.service[81311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:07:34.543214 dv-cinder-860997-1-smb devstack@keystone.service[81311]: from cryptography.utils import int_from_bytes Oct 13 04:07:34.544026 dv-cinder-860997-1-smb devstack@keystone.service[81310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:07:34.544026 dv-cinder-860997-1-smb devstack@keystone.service[81310]: from cryptography.utils import int_from_bytes Oct 13 04:07:34.544476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:07:34.544476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: from cryptography.utils import int_from_bytes Oct 13 04:07:34.544600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 04:07:34.544600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: from cryptography.utils import int_from_bytes Oct 13 04:07:34.593843 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:07:34.593976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:07:34.594123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 04:07:34.594225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] command line args: [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:07:34.594325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 04:07:34.594410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:07:34.594522 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] command line args: [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 04:07:34.594611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ================================================================================ {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:07:34.594795 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 04:07:34.594872 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] admin_token = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.594978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ================================================================================ {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 04:07:34.595062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] config_dir = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595316 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] admin_token = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] config_source = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] config_dir = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] debug = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.595768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.596985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] config_source = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.596985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] debug = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597110 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597420 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597536 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_config_append = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.597974 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_config_append = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598031 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_dir = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598091 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_file = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598206 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_dir = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598322 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_file = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598556 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598673 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598827 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598903 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.598967 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599764 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599897 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.599972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600092 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600167 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600324 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600652 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.600890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601059 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601362 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601592 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] publish_errors = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.601889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602128 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] publish_errors = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602763 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.602885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] standard_threads = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603839 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] standard_threads = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.603965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] use_journal = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] use_json = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604818 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] use_journal = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.604929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] use_stderr = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] use_json = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] use_syslog = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] use_stderr = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] use_syslog = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.605774 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 04:07:34.605890 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606241 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606591 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606702 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606821 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.606939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607056 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607284 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.607957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.608067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.608683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.608799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.608910 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609162 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609863 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.609981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610100 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610213 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610663 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.610965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611346 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611589 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611811 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.611921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612489 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.612989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613643 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.613982 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614204 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614437 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614769 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.614879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615573 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615693 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615804 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.615920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616669 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.616897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617156 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617502 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617614 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617844 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.617957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618516 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618628 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618850 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.618960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619543 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619848 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.619942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620086 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620597 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620711 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.620935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621188 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621316 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621542 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.621884 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622456 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622567 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.622929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623265 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623392 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.623882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.624525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.624647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.624772 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.624892 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625652 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625763 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.625986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626339 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.626915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627027 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627140 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627252 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627597 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.627932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.628929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629294 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629406 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629631 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629869 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.629981 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630318 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.630894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631126 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631465 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.external = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631717 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631843 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.631956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.external = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632543 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.password = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] auth.token = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.632903 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633056 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.password = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633413 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] auth.token = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.633991 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634104 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634232 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634787 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.634910 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.635940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636052 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636284 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.636984 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637098 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637238 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.637927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638384 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638498 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638853 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.638967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639427 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639653 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.639986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640560 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.640900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641275 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.641939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.642963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643110 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643235 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.643801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644346 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644458 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644692 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644805 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.644918 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645027 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.645883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646218 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646330 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.646902 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647360 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647699 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647811 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.647923 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648158 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648495 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.648954 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649581 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649694 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.649919 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650154 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650379 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650709 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.650935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651831 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.651943 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652063 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652516 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652629 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652749 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652863 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.652975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653245 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.653947 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654059 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654632 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.654989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.655588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.655702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.655814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.655927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656274 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656736 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656850 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.656962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657617 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.657963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658309 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658534 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.658992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659561 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.659900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660124 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660244 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.660927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661041 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.661975 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662659 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662773 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.662885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.663958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664184 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] role.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] role.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.664937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665400 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] role.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665516 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] role.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665742 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665854 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.665977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666091 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666316 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.666934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667276 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667622 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.667958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.668970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669225 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669339 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669630 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669745 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669859 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.669971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.670656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671629 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671855 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.671967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672860 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.672972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673489 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673604 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.673941 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674054 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674175 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674290 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674860 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.674974 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675204 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675549 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675663 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.675999 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676231 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676571 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.676926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677204 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.connection = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677672 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.677914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678153 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.connection = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678724 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.678950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679858 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.679970 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680091 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680318 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680430 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680542 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680775 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.680889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681264 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681850 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:07:34.681963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 04:07:34.681963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 04:07:34.709055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.709200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.709345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.709425 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.709525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.709609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.718377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.718552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.746792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.747020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.747109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.747292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.800597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.800741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.848880 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.849064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.849385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:34.849622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.004663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.004870 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005569 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005789 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.005927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.006144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.028348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.028605 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.028699 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.028800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.028931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.029846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.030084 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.040719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.040895 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.053826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054027 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054781 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.054995 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.055125 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.055203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.055340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 04:07:35.071703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.071873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.071956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 04:07:35.072088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 04:07:35.072238 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.072435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.072528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 04:07:35.072641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 04:07:35.072723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.072921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073009 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.073741 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.083587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.083865 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.083946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.084136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.084217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.084421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.084510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.084746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.091463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.091840 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.094460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.094749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.094887 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.095033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095468 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095759 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.095861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.096965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.097179 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.097261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.097460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.097736 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.121218 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.122036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.122657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.122943 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.123527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.123885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.127711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.127997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.128282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.128630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.128921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.129237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.134727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.135014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.135849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.136140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.141184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.141484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.141776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.142623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.142979 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.143170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.143258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.143477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.143761 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.144042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.144320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.158867 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.159149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.160045 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.160329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.163068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.164215 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.166415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.166712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.167549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.167850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.171503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.172629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.174774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.175775 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.178049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.178353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.178643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.178928 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.179935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.180218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.180501 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.195493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.195784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.196053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.196317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.196462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.196754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.197028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.197321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.203775 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.204778 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.205355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.206383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.206898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.207175 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.207925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.208206 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.209909 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.210195 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.210479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.210764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.211128 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.211208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.211423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.211712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.212000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.212391 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.222490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.222776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.223061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.223343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.223721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.223809 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.224010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.224092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.224289 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.224370 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.224576 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.224961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.225276 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.225569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.240612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.242041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.243574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.245003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.246506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.247964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.248074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.249564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.249792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.250076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.250476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.251052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.251338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.251745 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.256870 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.258222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.258373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.259690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.261278 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.261674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.261962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.262243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.262655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.263057 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.263347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.263628 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.270667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.270960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.271244 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.272092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.272383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.272665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.278210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.278495 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.278778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.279057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.279333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.279606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.279687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 04:07:35.279897 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.279986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.280880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281060 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281167 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281434 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281628 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.281899 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.282018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.282194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.282470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.282734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.283010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.283287 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 04:07:35.316642 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6668859c0 pid: 81311 (default app) Oct 13 04:07:35.318168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6668859c0 pid: 81310 (default app) Oct 13 04:07:35.320010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b514cc-6dbe-4697-afb4-2a356c664e25 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:35.320300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b514cc-6dbe-4697-afb4-2a356c664e25 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:35.320579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b514cc-6dbe-4697-afb4-2a356c664e25 None None] PATH_INFO: `/v3` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:35.324722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Oct 13 04:07:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:41.994927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722830-da51-45dc-889b-09ad84876932 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:41.995442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722830-da51-45dc-889b-09ad84876932 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:41.995548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722830-da51-45dc-889b-09ad84876932 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:41.999738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:07:42.005083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:42.005680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:42.005680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:42.075194 dv-cinder-860997-1-smb devstack@keystone.service[81311]: INFO dbcounter [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] Registered counter for database keystone Oct 13 04:07:42.094944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG oslo_db.sqlalchemy.engines [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:07:42.101085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writer thread running {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 04:07:42.279233 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG passlib.handlers.bcrypt [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 04:07:42.279538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG passlib.handlers.bcrypt [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 04:07:42.337512 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:42.339089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:42.467049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 04:07:42.917763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8722830-da51-45dc-889b-09ad84876932 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:42.987695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: INFO dbcounter [None req-e8722830-da51-45dc-889b-09ad84876932 None None] Registered counter for database keystone Oct 13 04:07:43.008615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG oslo_db.sqlalchemy.engines [None req-e8722830-da51-45dc-889b-09ad84876932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 04:07:43.014894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writer thread running {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 04:07:43.133623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8722830-da51-45dc-889b-09ad84876932 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:43.137882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:43.138507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:43.138788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:43.139060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:43.147189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:43.200562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 04:07:43.200850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45b14-a32c-4c06-b9b9-6a24c5347435 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:43.210080 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Oct 13 04:07:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 04:07:43.216213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:43.233786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507b54-731f-4988-b304-c52e3fee48a4 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:43.238176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:43.239267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:43.239551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:43.239822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] PATH_INFO: `/v3/projects/943bb932238542588166ff5bb66e3c95` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:43.241425 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] RBAC: Authorizing `identity:get_project(project_id=943bb932238542588166ff5bb66e3c95)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:43.296010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 04:07:43.296561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0acf1-efef-4487-a3fe-75f74eaaeb1a admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:43.301268 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:07:43 2022] GET /identity/v3/projects/943bb932238542588166ff5bb66e3c95 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:45.470288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e2dc-bb94-4a69-984d-67792ebe440f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:45.470800 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e2dc-bb94-4a69-984d-67792ebe440f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:45.470881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e2dc-bb94-4a69-984d-67792ebe440f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:45.474890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:07:45.480620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:45.481027 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:45.481208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:45.501559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:45.503062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:45.510764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 04:07:45.784239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161e2dc-bb94-4a69-984d-67792ebe440f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:45.796835 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161e2dc-bb94-4a69-984d-67792ebe440f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:45.800977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:45.801602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:45.801879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:45.802152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:45.809588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:45.811919 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f50d-e37e-4c62-881f-7b6d243d6ab6 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:45.820429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Oct 13 04:07:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 04:07:45.825643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:45.835113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc50c5-737d-4996-a467-6156ecc018a8 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:45.839436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:45.840063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:45.840347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:45.840623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] PATH_INFO: `/v3/users/b3e214467c9d452dbed4bb39c743bbc1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:45.841934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e214467c9d452dbed4bb39c743bbc1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:45.844299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a21665-be1b-4839-ad95-9259d09a9d6e admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:45.845857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Oct 13 04:07:45 2022] GET /identity/v3/users/b3e214467c9d452dbed4bb39c743bbc1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:47.999193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c90b-67f7-40ab-a7cf-5b30b3e5faff None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:47.999765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c90b-67f7-40ab-a7cf-5b30b3e5faff None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:47.999765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c90b-67f7-40ab-a7cf-5b30b3e5faff None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.001037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:48.006133 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.006585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.006677 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.024540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:48.025737 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:48.083965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54730-9761-4426-9f04-a580e40b94ad None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.084245 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54730-9761-4426-9f04-a580e40b94ad None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.084517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54730-9761-4426-9f04-a580e40b94ad None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.085874 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:07:48.091071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.091354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.091626 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.106443 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:07:48.134244 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG passlib.handlers.bcrypt [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81310) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 04:07:48.134629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG passlib.handlers.bcrypt [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81310) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 04:07:48.184310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:48.185853 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:48.282597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:07:48.376693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.401461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:48.480140 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ec25-b3f9-484f-b060-e98f4cd4886a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.512382 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.513008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.513311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.513585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.524709 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:07:48.534057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:07:48.535106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.536136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:07:48.543005 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.548523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.627761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:48.642487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d7fb-42f4-4da5-8220-90a6ad2594df None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.644826 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:48.646936 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1c418-0e95-4eee-8e1d-070ed06dc784 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.680050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.680655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.681245 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.681524 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.681896 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.682191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:48.682782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.683066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.683342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.683583 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:48.684179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:07:48.684515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:48.686007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:48.693240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.sql.core [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:07:48.693240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:07:48.693240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [parameters: {'id': 'e5b8c43c17fc4f83821d59e1698bfd1a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 04:07:48.693240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 04:07:48.698090 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:48.704312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:07:48.712498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 04:07:48.713494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application yield resource Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise self.value Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application session.commit() Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 04:07:48.714834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.flush() Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application compat.raise_( Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 04:07:48.715900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 04:07:48.717023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:07:48.718531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [parameters: {'id': 'e5b8c43c17fc4f83821d59e1698bfd1a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 04:07:48.720044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:07:48.721145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 8/16] 10.222.0.13 () {60 vars in 1137 bytes} [Thu Oct 13 04:07:48 2022] POST /identity/v3/domains => generated 190 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:07:48.722257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.810729 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62d18-ade5-42d8-88cc-cc7cb0075126 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.819459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13e72-c2af-41dd-a22e-56e97238d7ba None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.843833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.844677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.844954 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.845264 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] PATH_INFO: `/v3/users/b3e214467c9d452dbed4bb39c743bbc1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.846746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e214467c9d452dbed4bb39c743bbc1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:48.848181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:48.849758 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/users/b3e214467c9d452dbed4bb39c743bbc1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:48.855408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.855771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.856403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.856695 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.856972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.867082 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:48.868557 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:48.875859 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:07:48.885553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:07:48.886490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:07:48.887301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:07:48.887301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:07:48.887301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:07:48.888859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:48.889837 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:07:48.895666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:48.959973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473661-28c7-4486-a7d5-5863438962b3 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.992411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134c49-fc2f-4374-a4b4-04aacb1226d4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:48.992854 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:48.993512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:48.993803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:48.994074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:48.995195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:48.996645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:48.998221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:49.004347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:49.025418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:49.026018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:49.026296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:49.026568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:49.027210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:07:49.027512 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:49.028879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33afe0-321d-4fa7-ac8c-ae2ca7f1f8b6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:49.046461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:49.105924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c088f-e700-40ad-bed4-1d2c9873f87e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:49.107574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:49.142350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:49.143025 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:49.143314 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:49.143590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] PATH_INFO: `/v3/domains/default/users/b3e214467c9d452dbed4bb39c743bbc1/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:49.145604 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b3e214467c9d452dbed4bb39c743bbc1, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:49.147077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36cdd7-aff6-4d46-80b7-35a79171e143 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:49.266740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Oct 13 04:07:49 2022] PUT /identity/v3/domains/default/users/b3e214467c9d452dbed4bb39c743bbc1/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:07:51.653523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c23f-c959-4755-9dac-b7b2bfa72fbc None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:51.654033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c23f-c959-4755-9dac-b7b2bfa72fbc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:51.654033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c23f-c959-4755-9dac-b7b2bfa72fbc None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:51.655418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:51.662039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550091c5-ca7c-4888-aaa3-6e16e58e2b7c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:51.662551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550091c5-ca7c-4888-aaa3-6e16e58e2b7c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:51.662622 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550091c5-ca7c-4888-aaa3-6e16e58e2b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:51.687658 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-550091c5-ca7c-4888-aaa3-6e16e58e2b7c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:51.689219 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-550091c5-ca7c-4888-aaa3-6e16e58e2b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:51.777443 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6184-ccca-466a-b476-074e9a5d42d6 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:51.777792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6184-ccca-466a-b476-074e9a5d42d6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:51.778002 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6184-ccca-466a-b476-074e9a5d42d6 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:51.779380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:51.792927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffbc2-9f00-411a-b2ed-ea1cccb10dab None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:51.793301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffbc2-9f00-411a-b2ed-ea1cccb10dab None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:51.793579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ffbc2-9f00-411a-b2ed-ea1cccb10dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:51.796220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:51.830146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-af4ffbc2-9f00-411a-b2ed-ea1cccb10dab None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:51.831328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-af4ffbc2-9f00-411a-b2ed-ea1cccb10dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:51.901014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:51.922693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:07:52.109744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f641d-f8ac-4305-8155-dc55190014a8 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.110425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f641d-f8ac-4305-8155-dc55190014a8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.110912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f641d-f8ac-4305-8155-dc55190014a8 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.115615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 13/26] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:52.120646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368c1d-66dc-4a7b-b075-489a1e4826b5 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.120930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368c1d-66dc-4a7b-b075-489a1e4826b5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.121236 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368c1d-66dc-4a7b-b075-489a1e4826b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.132347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f641d-f8ac-4305-8155-dc55190014a8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:52.149189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-a3368c1d-66dc-4a7b-b075-489a1e4826b5 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:52.150381 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-a3368c1d-66dc-4a7b-b075-489a1e4826b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:52.246638 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:52.248283 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d61d-1f23-459a-b82c-2498a59cdbc9 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.248818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d61d-1f23-459a-b82c-2498a59cdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.249339 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d61d-1f23-459a-b82c-2498a59cdbc9 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.254613 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:52.261237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.262937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.263626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.294702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:52.296256 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:52.313108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:52.324619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f641d-f8ac-4305-8155-dc55190014a8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:52.377869 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:52.378521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.378802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.379083 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.405996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:52.407161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:52.417766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:07:52.426703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:07:52.427563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:07:52.428332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:07:52.433762 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:52.494832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:52.600843 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a37e-3a01-443a-87d8-03ccc310612d None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:52.645781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:52.646786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.647270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.647768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.648647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:52.651032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:52.677317 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822943e6-24b4-4593-8d69-ca74d637bc1e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:52.767302 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:52.767929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.768212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.768487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.769185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:07:52.769494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:52.771006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:52.786307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:52.787040 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:52.798916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 17/32] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Oct 13 04:07:52 2022] POST /identity/v3/roles => generated 219 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:07:52.805613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:52.805935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:52.900297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ff0db-7fef-4b53-bdf7-6dbafbbccecd None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:52.941621 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:52.942310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:52.942594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:52.942872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:52.966597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:52.966597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:07:52.983744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:07:52.984681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:07:52.985543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:07:52.985543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:07:52.985543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:07:52.985543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:07:52.986470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:53.013506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef7e08-356b-4407-8eb6-e0638b379704 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.035526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:53.069981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:53.103676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52171898-2aa6-40c8-94e7-4fc3bf562a28 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.115660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.115660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.115660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.115660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.116376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.117936 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.143208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.144128 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.144588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.144868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] PATH_INFO: `/v3/users/b3e214467c9d452dbed4bb39c743bbc1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.145414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 18/34] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Oct 13 04:07:52 2022] POST /identity/v3/roles => generated 225 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:07:53.146243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:53.150060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e214467c9d452dbed4bb39c743bbc1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.151665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.153278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 17/35] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:07:52 2022] GET /identity/v3/users/b3e214467c9d452dbed4bb39c743bbc1 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:53.158910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:53.294957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ffa2-8fc0-4248-877c-90f050e93ca3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.320437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b006-2a47-4388-8304-a7fceec8d057 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.350693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.351996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.352625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.353377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.354335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:07:53.354842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.356700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.367755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.368493 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.368845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.369253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.370479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.372055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.374106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:53.380348 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:53.381041 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 19/37] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:53.383163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:53.387128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:53.429034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:53.491171 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe598-5c22-424c-97c3-f5a8e4425dd5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.535515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.535838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.536159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.536428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.537273 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.domain.id=default, user.id=b3e214467c9d452dbed4bb39c743bbc1) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:07:53.537512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.538994 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e83e-a878-4f31-9e75-c83788c7ad64 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.548359 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Oct 13 04:07:53 2022] GET /identity/v3/role_assignments?user.id=b3e214467c9d452dbed4bb39c743bbc1&scope.domain.id=default&role.id=b14e21de15a34f23963248e91563ee32 => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:07:53.549686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d43bb-2dd7-4c27-b43e-282d26b4260f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.549970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d43bb-2dd7-4c27-b43e-282d26b4260f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.550248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d43bb-2dd7-4c27-b43e-282d26b4260f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.551512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 20/39] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:53.552651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c450d-8f04-4b55-aca9-0a394879c31c None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.552928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c450d-8f04-4b55-aca9-0a394879c31c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.553349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c450d-8f04-4b55-aca9-0a394879c31c None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.555085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 21/40] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:53.560812 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe512-2aa9-4370-831f-11725741b6dc None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.561696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe512-2aa9-4370-831f-11725741b6dc None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.561973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe512-2aa9-4370-831f-11725741b6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.583847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c6cbe512-2aa9-4370-831f-11725741b6dc None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:53.585416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c6cbe512-2aa9-4370-831f-11725741b6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:53.632261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2fcfc-8ba8-4c54-9f3d-40a1662e3e93 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:53.661555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:53.681248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 22/41] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:53.681248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.681248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.681248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.683823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:53.684549 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:53.684947 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:53.685323 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:53.686737 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:53.688369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:53.701033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:53.702936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:53.726477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 20/42] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:07:53 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:07:53.798219 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:53.957508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:54.036372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:54.056344 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef71a0-4b3e-4f2c-bd4f-0dd90d29fa07 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:54.060382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:54.090790 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:54.091417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:54.091699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:54.091973 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:54.093656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:54.095120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:54.096663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 21/44] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:54.101974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:54.161766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374d09-8ab3-40fc-9b0f-0905162b2942 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:54.187269 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:54.196188 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:54.196806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:54.197105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:54.197391 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:54.198055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:54.199433 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d282a-dcc0-47f0-9b48-659765a5ee30 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:54.201150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159bd8e-1343-48dd-b306-b01ea55933f7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:54.215326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 24/45] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Oct 13 04:07:54 2022] POST /identity/v3/roles => generated 223 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:07:54.238520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:54.239161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:54.239446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:54.239724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:54.240398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:54.241950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa474914-9ac1-4b02-a7f2-83417015fee1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:54.266896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:54.275464 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:07:54 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:07:56.403644 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c884-3f24-4e70-8061-de44f2841536 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:56.404132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c884-3f24-4e70-8061-de44f2841536 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:56.404211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c884-3f24-4e70-8061-de44f2841536 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:56.405592 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:56.410778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:56.411182 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:56.411330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:56.429299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:56.430786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:56.495235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:56.764432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c884-3f24-4e70-8061-de44f2841536 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:56.864816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c884-3f24-4e70-8061-de44f2841536 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:56.896350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:56.896964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:56.897275 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:56.897555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:56.898639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:56.900082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e4022-8bec-453d-9955-6828a1db01d8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:56.901647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 26/49] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:56.907787 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:57.004566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79f1de-fda8-4704-8a39-0077f6609591 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:57.032159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:57.037898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:57.038505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:57.038792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:57.039071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:57.039721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:57.041205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf734-3673-4832-ab1d-82db4248148b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:57.066357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 24/50] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Oct 13 04:07:56 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:07:59.191887 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aaeb8-5c25-4efc-a1c2-14d68ac9190f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:59.192428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aaeb8-5c25-4efc-a1c2-14d68ac9190f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:59.192428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aaeb8-5c25-4efc-a1c2-14d68ac9190f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:59.193827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 27/51] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:07:59.198892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:59.199306 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:59.199455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:59.218723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:07:59.219896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:07:59.284269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 25/52] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:07:59.552698 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795aaeb8-5c25-4efc-a1c2-14d68ac9190f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:59.608709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:59.652530 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795aaeb8-5c25-4efc-a1c2-14d68ac9190f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:59.684490 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:59.685111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:59.685417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:59.685689 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:59.687293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:59.688718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262b35-bccc-446f-9a7a-e7a084809f65 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:59.690278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 28/53] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:07:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:07:59.695901 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:07:59.790488 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf061c5-e556-4df1-aaec-8cd372158dbd None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:07:59.803655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:07:59.824374 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:07:59.824977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:07:59.825292 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:07:59.825568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:07:59.826222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:07:59.828180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9830-b5a1-408d-a6ee-1ce02bd08f56 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:07:59.854445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 26/54] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:07:59 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:03.100197 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ea0-ee88-428a-93e8-31bb2de90e5a None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.100197 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ea0-ee88-428a-93e8-31bb2de90e5a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.100197 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece3ea0-ee88-428a-93e8-31bb2de90e5a None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.100197 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 29/55] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:03.106674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7118-cf48-4ed9-b0ba-23b9df17529d None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.108123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7118-cf48-4ed9-b0ba-23b9df17529d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.108624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7118-cf48-4ed9-b0ba-23b9df17529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.138183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-864f7118-cf48-4ed9-b0ba-23b9df17529d None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:03.139792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-864f7118-cf48-4ed9-b0ba-23b9df17529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:03.230642 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 27/56] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:03.269730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76b55-4eff-4784-ba6d-614fa239073e None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.270352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76b55-4eff-4784-ba6d-614fa239073e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.270871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76b55-4eff-4784-ba6d-614fa239073e None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.272518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 30/57] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:03.278484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.279076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.279595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.310131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:03.312172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:03.369611 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8a9c-b0a7-4c64-a248-28ea0fa97a89 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.369898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8a9c-b0a7-4c64-a248-28ea0fa97a89 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.370087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8a9c-b0a7-4c64-a248-28ea0fa97a89 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.371429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 31/58] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:03.376696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.376988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.377299 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.408753 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:03.409964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:03.432604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:03.510658 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 32/60] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:03.573490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:03.603652 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:03.716542 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6581f35-7833-425d-bb45-d5e36cd5abd5 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:03.752901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:03.765531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:03.766195 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.766487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.767046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.781279 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-6e73c2f5-605b-42b4-a25d-27f6df41a4d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:03.786530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:03.787400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:03.788552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 29/61] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:03.794216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67025-0596-494d-a63f-769c32050dad None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.794634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67025-0596-494d-a63f-769c32050dad None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.794920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67025-0596-494d-a63f-769c32050dad None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.796482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 30/62] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:03.797399 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67025-0596-494d-a63f-769c32050dad None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:03.817041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:03.865620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9780fcf-2394-4529-b413-b4f778420d34 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:03.892389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:03.900324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:03.900970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.901290 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.901569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.905578 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67025-0596-494d-a63f-769c32050dad None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:03.911459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-fc4329aa-e6f5-4ada-9c56-4bfb7a191ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:03.916373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:03.917345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:03.918154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 33/63] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:03.919148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.919444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.919705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.937822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:03.939311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:03.941632 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:03.942247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.942525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.942798 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.943463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:03.943766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:03.945174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebf78-ed34-43a4-9e7b-aabbc244b381 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:03.956939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 31/64] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:03.958138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74f48-b3ca-4a5f-8cfa-6cddc8b7b6b5 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:03.958417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74f48-b3ca-4a5f-8cfa-6cddc8b7b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:03.958689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74f48-b3ca-4a5f-8cfa-6cddc8b7b6b5 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:03.959874 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 32/65] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:03.960566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b74f48-b3ca-4a5f-8cfa-6cddc8b7b6b5 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.010803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:04.011733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.071555 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b74f48-b3ca-4a5f-8cfa-6cddc8b7b6b5 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.110307 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.111084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.111267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.111528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.123953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:04.128899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:04.129759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:04.130565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 33/67] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:04.131199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.145479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.174829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.236720 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a969a9-a32b-4cc5-a205-fa518d700d74 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.243012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9ab5-2bb0-4914-bacb-b7d0175f5ba3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.274861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.275401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.275680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.275953 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.276614 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:04.276915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.277501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.278137 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.278320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc05b1c-15f2-466c-a191-9dd838d6351f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.278406 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.278688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.286517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 35/68] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.287878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.288175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.288459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.292940 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.294466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.296861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.297409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.307071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:04.308268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:04.368733 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.377705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 36/70] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:04.386513 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.413379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.416450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ce0da-02f4-43eb-bfbd-6f2c340b6053 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.453462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.454088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.454375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.454656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.455338 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:04.455651 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.457485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.466206 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.467078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.487832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3cbd-9053-4036-a119-826abebae191 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.523852 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.524742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.525278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.525726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.536131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:04.541324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:04.542141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:04.542888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:04.545995 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:04.547644 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.570114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f96aec-faab-4df3-ad51-fc9913f066cf None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.598511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.605698 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.606389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.606687 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.606957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] PATH_INFO: `/v3/users/b3e214467c9d452dbed4bb39c743bbc1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.608605 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] RBAC: Authorizing `identity:get_user(user_id=b3e214467c9d452dbed4bb39c743bbc1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.610092 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.611674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/users/b3e214467c9d452dbed4bb39c743bbc1 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.612435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.654154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.662046 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad22d82-65de-40d1-ace6-ad1c992769b8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.695484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.696119 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.696406 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.696694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.697863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.699313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.700929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.706590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.716778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f696d4-ef6d-46de-899b-7294b5c0dfcc None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.749635 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.750258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.750537 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.750809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.751992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.753470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.755036 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.755785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.802996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f9904-616d-401c-a897-f3090a6fe245 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.818185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.835538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.836152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.836439 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.836715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.837416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:04.837722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.839098 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.847769 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.848553 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.853945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783355-549e-4f98-93f3-19f2cb49af96 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.874074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:04.886958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.887581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.887860 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.888138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.889336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.890789 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.892404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 38/77] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.892404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.949176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c543d9-b55a-493e-b86a-ab101bbe2641 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:04.982312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:04.983015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:04.983297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:04.983579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:04.984696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:04.986183 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:04.987901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:04.988589 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:04.991227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493f83-7d88-4978-908f-b52a7cc52291 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.024948 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.025646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.025932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.026213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.028135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, user_id=aeefeb7090314670ac1c4ff3aa09fb73, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.029686 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.031885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.043417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:04 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:05.044210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.085714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.096703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4359058-4605-429e-9a65-1efce718db30 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.136975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.137958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.138249 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.138532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.140302 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.141809 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.143883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:04 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:05.144736 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.163780 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a02c58-75e7-4c87-bdc5-e316bb68b5af None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.203937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.204618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.204955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.205267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.206468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.207940 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.209750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:05 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:05.213997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.260532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00a107-b213-4aa4-b5b3-e3c6494e7fa9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.280294 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.299863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.300685 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.300988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.301297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/users/b3e214467c9d452dbed4bb39c743bbc1/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.303630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, user_id=b3e214467c9d452dbed4bb39c743bbc1, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.305079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.320160 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:05 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/users/b3e214467c9d452dbed4bb39c743bbc1/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:05.320968 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.327769 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7dfcf-bcec-47f6-85d8-d8cd96c0b184 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.348561 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.396183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.397218 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.398043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.398386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.399399 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.401712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.432534 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 41/83] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:05 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:05.438485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.465560 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8759-3131-4793-b4df-668bbb50d41b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.534509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.535489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.536240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.536547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.539239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, user_id=aeefeb7090314670ac1c4ff3aa09fb73, role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.541059 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.563145 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:05 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/a3fc537dd6f9468895373cc15d975f81 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:05.588862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742cfa-1ecb-4acb-92bd-ad4ad89f6866 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.621810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.645316 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.646057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.646349 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.646632 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] PATH_INFO: `/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.649827 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] RBAC: Authorizing `identity:get_project(project_id=9d214d4d86d94498a06ab8bf0ec1f8c0)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.651480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5b47f-dace-44ed-a2fd-8ce66e1649e3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.653310 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:05 2022] GET /identity/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:05.659865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:05.778062 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:05.800904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978587a-575b-4fd8-9aa5-c743379b2912 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:05.838038 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:05.838707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:05.838988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:05.839264 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] PATH_INFO: `/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:05.841248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d214d4d86d94498a06ab8bf0ec1f8c0, user_id=aeefeb7090314670ac1c4ff3aa09fb73, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:05.842918 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542bbb-d6a9-451a-aa87-07361b42805c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:05.861381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:05 2022] PUT /identity/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0/users/aeefeb7090314670ac1c4ff3aa09fb73/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:07.656114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3fa8-d437-49e3-a8d3-d626e403aff5 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:07.656598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3fa8-d437-49e3-a8d3-d626e403aff5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:07.656598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3fa8-d437-49e3-a8d3-d626e403aff5 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:07.657935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:07.669699 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eb423-683b-4017-9d49-80c59ddab411 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:07.670692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eb423-683b-4017-9d49-80c59ddab411 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:07.670888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eb423-683b-4017-9d49-80c59ddab411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:07.698222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ab1eb423-683b-4017-9d49-80c59ddab411 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:07.699434 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ab1eb423-683b-4017-9d49-80c59ddab411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:07.786201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:07.916894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521ece-e681-4824-b065-ff4287bd479e None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:07.917219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521ece-e681-4824-b065-ff4287bd479e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:07.917483 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521ece-e681-4824-b065-ff4287bd479e None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:07.919088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 44/89] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:07.925594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:07.925882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:07.926166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:07.950144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:07.951381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:08.025636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:08.032330 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 46/90] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:08.266018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521ece-e681-4824-b065-ff4287bd479e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:08.469918 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521ece-e681-4824-b065-ff4287bd479e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:08.530513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:08.531160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:08.531446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:08.531725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:08.542568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:08.587576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-da4d6886-3ee9-483f-81f5-8238bcfacd29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:08.602933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:08.604067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:08.604824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:08.609084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 45/91] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:08.610833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f473c4-365b-47b6-8a78-4b3d917b4f2b None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:08.611123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f473c4-365b-47b6-8a78-4b3d917b4f2b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:08.611401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f473c4-365b-47b6-8a78-4b3d917b4f2b None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:08.624225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 46/92] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:08.624225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f473c4-365b-47b6-8a78-4b3d917b4f2b None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:08.773540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:08.834419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83504f1-7028-438e-9b81-1adf36fb4bfa None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:08.907400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f473c4-365b-47b6-8a78-4b3d917b4f2b None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:08.917016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:08.917696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:08.921161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:08.921161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:08.947909 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-f2ed93b5-0c7a-4801-a26c-4bad6b1de107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:08.954141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:08.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:08.955898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:08.958032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 47/93] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:08.964980 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:08.966194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:08.966694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.001908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:09.007868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:09.020115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.020976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.021434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.021855 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.022683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:09.024348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.025926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.048631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 47/94] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.049615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.092315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.106931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:09.108633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.222924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19261f6-f826-4ccd-a878-4c31ed5ff162 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.226725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158f68f-7b57-413d-b3ca-775c7138b05e None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.247149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.266151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.267217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.267694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.268201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.269608 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.272230 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217a6d-8a09-42e0-b077-e08c4bdb5f80 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.274326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.275731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021af3b-c3ac-4ea9-928d-a09a6b20390e None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.276200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021af3b-c3ac-4ea9-928d-a09a6b20390e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.276656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021af3b-c3ac-4ea9-928d-a09a6b20390e None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.278359 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 50/97] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:09.280407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.280617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218d15-78c2-4cb7-ab7f-158a0eaf662c None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.281067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218d15-78c2-4cb7-ab7f-158a0eaf662c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.281188 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.281479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.281761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.281996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25218d15-78c2-4cb7-ab7f-158a0eaf662c None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.282442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:09.282752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.283972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 51/98] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:09.284290 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae24f5c-6dd9-4e26-92ef-c0aa5cf74c73 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.285060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25218d15-78c2-4cb7-ab7f-158a0eaf662c None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.293794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 48/99] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.299497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0147-296b-497f-8554-581a7d91704e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.299497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0147-296b-497f-8554-581a7d91704e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.299497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef0147-296b-497f-8554-581a7d91704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.330411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-2fef0147-296b-497f-8554-581a7d91704e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:09.331764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2fef0147-296b-497f-8554-581a7d91704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:09.367335 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.419215 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25218d15-78c2-4cb7-ab7f-158a0eaf662c None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.420449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:09.423143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.423583 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.424054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.448965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:09.450993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:09.457782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.458510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.458902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.459283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.525378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 50/101] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:09.536273 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.538013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.538243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d12b4d-31a6-4303-ba15-b8b0183616a2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.571362 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.613004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.652892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144ff9-f68c-458a-96b6-b873c52f0a1a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.659579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 52/102] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:09.660889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5edc5-ec0c-47b5-9619-8ae497b35e7f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.661554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5edc5-ec0c-47b5-9619-8ae497b35e7f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.661554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5edc5-ec0c-47b5-9619-8ae497b35e7f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.663212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 53/103] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:09.664642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5edc5-ec0c-47b5-9619-8ae497b35e7f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.690165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.691069 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.691533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.692015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] PATH_INFO: `/v3/users/b3e214467c9d452dbed4bb39c743bbc1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.693356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] RBAC: Authorizing `identity:get_user(user_id=b3e214467c9d452dbed4bb39c743bbc1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.694994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.696757 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 51/104] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/users/b3e214467c9d452dbed4bb39c743bbc1 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.700826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.779492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5edc5-ec0c-47b5-9619-8ae497b35e7f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.807199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.812515 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5029c-cca0-4d61-8c6b-b28c5e94b21d None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.815684 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.816394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.816680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.816948 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.827500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-354b9440-e2a2-4064-9de8-209463a70abd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:09.832284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:09.833148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:09.834061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 54/105] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:09.835265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.835265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.835265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.851061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.851694 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.851978 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.852254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.852668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:09.853722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.854117 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:09.855179 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.857234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 52/106] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.857619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.868677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:09.921075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 55/107] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:09.921939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:09.957487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0f27-e33e-4f36-81a5-4db8a7179f39 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:09.993009 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840905cf-3b27-4686-9141-285f11841580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:09.993877 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840905cf-3b27-4686-9141-285f11841580 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:09.994161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840905cf-3b27-4686-9141-285f11841580 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:09.994442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840905cf-3b27-4686-9141-285f11841580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:09.995539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840905cf-3b27-4686-9141-285f11841580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:09.997004 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840905cf-3b27-4686-9141-285f11841580 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:09.998738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 53/108] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:09.999577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840905cf-3b27-4686-9141-285f11841580 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.030702 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb31cf-f47c-4a3f-97b1-56d409272d47 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.039588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.065041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.065740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.066025 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.066353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.084956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.114102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840905cf-3b27-4686-9141-285f11841580 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.139507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.141090 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.150445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.151084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.151731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.152017 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.162855 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:10.167755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:10.168594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:10.169407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 54/109] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:10.170594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.248064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 56/110] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:10.253339 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.265622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.272442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97201d-ee14-4929-a1f3-dbd426d54da1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.300588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.305600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.306219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.306508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.306788 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.307465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:10.307783 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.309211 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.317424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 55/111] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.318227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.356093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba334-3451-4546-bdd9-10c0509dce0d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.389874 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.390480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.390760 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.391033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.391756 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] RBAC: Adding query filter params (role.id=3a9f5bd18c8140c89d65305279cf6577, scope.project.id=319ecf7437db4713a62636cc599d9f81, user.id=aeefeb7090314670ac1c4ff3aa09fb73) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:10.392064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.393541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.400191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 57/112] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/role_assignments?user.id=aeefeb7090314670ac1c4ff3aa09fb73&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.400979 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.432172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb9bf8-2e73-4da8-a0fa-ae2f8aa0ef33 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.470923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.471595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.471824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.472101 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.472779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.474347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.504240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 56/113] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:08:10 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:10.504846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.516533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489884ba-b0a7-44ff-8a8c-648174d45723 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.518968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.542213 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.576737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.578475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.578912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.579615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.580461 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:10.581268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.583477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.596933 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 58/114] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.598078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.658975 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfd6e9-755a-4f1b-96c3-c8d53de7014c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.704929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.705624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.705905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.706178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.718427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:10.723602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:10.724554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:10.725533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 57/115] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:10.729644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.733539 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f93a-1072-4378-8cfe-25bc207d8af9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.769746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.770311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.770597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.770880 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.772007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.773511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.775164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 59/116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.775941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.806027 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.825446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:10.842413 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab103-96d0-4896-af51-d701f62ae2f3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.878518 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.879271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.879551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.879828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.881105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.882633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.888875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 58/117] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.888875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:10.892212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5aec-04d1-4ebb-bb8e-4dbe86e555b4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:10.929266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:10.929912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:10.930201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:10.930482 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] PATH_INFO: `/v3/users/aeefeb7090314670ac1c4ff3aa09fb73` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:10.932079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] RBAC: Authorizing `identity:get_user(user_id=aeefeb7090314670ac1c4ff3aa09fb73)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:10.934266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:10.941101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 60/118] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/users/aeefeb7090314670ac1c4ff3aa09fb73 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:10.941101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.000089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80914-f3c7-4c0a-b7d1-ad21cf5577ea None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.036378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.036933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.037233 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.037514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.038187 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:11.038494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.039874 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.041545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369446c-c9a0-4d1b-b1b8-033245d348da None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.042054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.050885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 59/119] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.054905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.056586 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.080490 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.081220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.081567 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.081911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.082716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=319ecf7437db4713a62636cc599d9f81, user.id=b3e214467c9d452dbed4bb39c743bbc1) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:11.083024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.084468 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.090401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 61/120] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:10 2022] GET /identity/v3/role_assignments?user.id=b3e214467c9d452dbed4bb39c743bbc1&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.091180 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.205822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737162-ae0c-46e8-88a9-193da21f4546 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.207988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d739-667b-4818-b15e-ea05edc57cc7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.245936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.246735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.247115 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.247488 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.255057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.255921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.256407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.256817 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.301216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.333900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.335216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.352622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.356551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.358777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.452670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:11.452670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.467448 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:11.468440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.533972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.562743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f452c-61be-4f39-8bad-65e8b74240ff None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.566451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.570469 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097b960-ae3f-467c-b163-6a77e2ff5ac3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.599397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.600123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.600403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.600725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] PATH_INFO: `/v3/users/fbaa3c1d1d9545e3ba2646ee24295682` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.604862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.605523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.605808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.606087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] PATH_INFO: `/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.607216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] RBAC: Authorizing `identity:get_project(project_id=9d214d4d86d94498a06ab8bf0ec1f8c0)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.608689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.613163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 61/123] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/projects/9d214d4d86d94498a06ab8bf0ec1f8c0 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.613163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.621429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] RBAC: Authorizing `identity:get_user(user_id=fbaa3c1d1d9545e3ba2646ee24295682)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.623569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.629860 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 63/124] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/users/fbaa3c1d1d9545e3ba2646ee24295682 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.629860 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.716426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a610d0-68a0-4ba1-a2c5-e2b1c9f0c090 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.735532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bff5e5-bae1-485e-aeb3-8a962fa5bc78 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.750484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.751128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.751705 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.751705 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.753847 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.755300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.757114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.758156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.772177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.778000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.778613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.778891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.779181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.779916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] RBAC: Adding query filter params (role.id=3a9f5bd18c8140c89d65305279cf6577, scope.project.id=9d214d4d86d94498a06ab8bf0ec1f8c0, user.id=aeefeb7090314670ac1c4ff3aa09fb73) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:11.780226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.781707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.788003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 64/126] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/role_assignments?user.id=aeefeb7090314670ac1c4ff3aa09fb73&scope.project.id=9d214d4d86d94498a06ab8bf0ec1f8c0&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.789635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.798172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:11.874904 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dae1e0-bcbb-44d8-8057-6c35001eceed None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.914936 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.915618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.915962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.916243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.917432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.919118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.919669 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5b00-b504-47d8-8824-15277f329f61 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:11.921438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 63/127] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:11.930178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:11.968615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:11.969645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:11.970152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:11.970590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:11.971512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] RBAC: Adding query filter params (role.id=a3fc537dd6f9468895373cc15d975f81, scope.project.id=319ecf7437db4713a62636cc599d9f81, user.id=aeefeb7090314670ac1c4ff3aa09fb73) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:11.972011 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:11.974893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf1276-7e68-4711-befa-2b5a7f7fc033 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:11.984277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 65/128] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:11 2022] GET /identity/v3/role_assignments?user.id=aeefeb7090314670ac1c4ff3aa09fb73&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=a3fc537dd6f9468895373cc15d975f81 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:12.057657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a1aa1-4d4d-4102-a9fd-f846fd608ea0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:12.059564 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:12.098296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:12.099222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:12.099650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:12.100091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/users/fbaa3c1d1d9545e3ba2646ee24295682/roles/71f7b5e886d54387ad0234efb1a4e16e` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:12.102375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, user_id=fbaa3c1d1d9545e3ba2646ee24295682, role_id=71f7b5e886d54387ad0234efb1a4e16e)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:12.104287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad427b23-0440-4163-b635-47c574fc32b3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:12.120851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 64/129] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:11 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/users/fbaa3c1d1d9545e3ba2646ee24295682/roles/71f7b5e886d54387ad0234efb1a4e16e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:12.729678 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fc05-8aba-4d25-8f97-8777729adc88 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:12.729965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fc05-8aba-4d25-8f97-8777729adc88 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:12.730243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fc05-8aba-4d25-8f97-8777729adc88 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:12.731597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 66/130] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:12.737445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df634-9c91-4252-83b5-8a2100593319 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:12.737744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df634-9c91-4252-83b5-8a2100593319 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:12.738029 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df634-9c91-4252-83b5-8a2100593319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:12.756887 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-190df634-9c91-4252-83b5-8a2100593319 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:12.758159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-190df634-9c91-4252-83b5-8a2100593319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:12.823520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 65/131] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:13.097479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fc05-8aba-4d25-8f97-8777729adc88 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:13.156320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:13.196341 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fc05-8aba-4d25-8f97-8777729adc88 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:13.228697 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:13.229344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:13.229629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:13.229904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:13.230989 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:13.232460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f21b-c4d0-4926-8326-8b17314d3251 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:13.234049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 67/132] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:13.239590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190df634-9c91-4252-83b5-8a2100593319 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:13.329113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:13.338893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190df634-9c91-4252-83b5-8a2100593319 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:13.373748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:13.374286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:13.374563 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:13.374831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:13.375485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:13.376916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922f69d-cd7b-4960-bc57-b56437b8e55c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:13.397040 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 66/133] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:13 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:08:14.231003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54169-9524-4140-997b-0b4b5df088d1 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:14.231513 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54169-9524-4140-997b-0b4b5df088d1 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:14.231585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54169-9524-4140-997b-0b4b5df088d1 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:14.233485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 68/134] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:14.238791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:14.239083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:14.239357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:14.257681 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:14.258851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:14.330403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 67/135] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:14.595786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54169-9524-4140-997b-0b4b5df088d1 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:14.696626 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54169-9524-4140-997b-0b4b5df088d1 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:14.723168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:14.730958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:14.731602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:14.731882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:14.732160 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:14.744013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:14.749552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:14.750390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:14.751680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 69/136] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:14.756699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:14.838022 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:14.862081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee8574-381c-4cc4-a2bf-ef33309b406b None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:14.897593 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:14.898213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:14.898493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:14.898767 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:14.899442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:14.899748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:14.901206 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:14.909820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 68/137] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:14.915726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:15.015186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592114e1-d97c-4ec7-a4cb-55184030f08d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:15.052591 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:15.053251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.053535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.053810 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] PATH_INFO: `/v3/users/fbaa3c1d1d9545e3ba2646ee24295682` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.054934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] RBAC: Authorizing `identity:get_user(user_id=fbaa3c1d1d9545e3ba2646ee24295682)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:15.056421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:15.058079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 70/138] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:14 2022] GET /identity/v3/users/fbaa3c1d1d9545e3ba2646ee24295682 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:15.063655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:15.165723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ac3a-88e1-4d52-8917-5959f3f6abe4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:15.200337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:15.200980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.201361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.201635 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.212707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:15.277504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:15.280270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:15.380292 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 69/139] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:15.385992 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:15.448900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:15.496521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66485c-54ce-48d5-8122-da84c0b52176 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:15.531902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:15.532545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.532827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.533102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.534318 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:15.535752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f403b4d-2435-481b-b2a6-e4b9ef19e6e7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:15.537396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 71/140] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:15 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:15.543507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:15.586757 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:15.655917 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1805f-e467-47eb-b3bd-fe99dfe56568 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:15.691976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:15.692594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.692871 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.693153 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.693902 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] RBAC: Adding query filter params (role.id=71f7b5e886d54387ad0234efb1a4e16e, scope.project.id=319ecf7437db4713a62636cc599d9f81, user.id=fbaa3c1d1d9545e3ba2646ee24295682) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:15.694213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:15.695668 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3736b-69c5-4d98-98c8-54aea719c4df None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:15.704090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 70/141] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:15 2022] GET /identity/v3/role_assignments?user.id=fbaa3c1d1d9545e3ba2646ee24295682&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=71f7b5e886d54387ad0234efb1a4e16e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:15.715499 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a07b-0cec-4ed8-9be7-22f0a968530c None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.715792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a07b-0cec-4ed8-9be7-22f0a968530c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.716073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62a07b-0cec-4ed8-9be7-22f0a968530c None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.717612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 72/142] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:15.724122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc290e8-179c-40b2-b4b1-da1ab67e6f9b None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.724740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc290e8-179c-40b2-b4b1-da1ab67e6f9b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.725229 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc290e8-179c-40b2-b4b1-da1ab67e6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.746303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-3dc290e8-179c-40b2-b4b1-da1ab67e6f9b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:15.748503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-3dc290e8-179c-40b2-b4b1-da1ab67e6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:15.834488 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 71/143] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:15.887985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3677-f037-4338-9f6d-2df482c46f85 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.888309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3677-f037-4338-9f6d-2df482c46f85 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.888627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3677-f037-4338-9f6d-2df482c46f85 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.890009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 73/144] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:15.895374 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.895666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.895932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.899441 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc834c9-6176-4b49-a194-75df8e1ab4f7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.899727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc834c9-6176-4b49-a194-75df8e1ab4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.900007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc834c9-6176-4b49-a194-75df8e1ab4f7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.901623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 74/145] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:15.911951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:15.912246 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:15.912530 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:15.920480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:15.921161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:15.936749 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:15.938129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:15.952545 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.005840 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 72/146] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:16.015633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 75/147] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:16.124897 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.225966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fb92-0fbf-4e22-959e-5d023c3f4987 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.259660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.260510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.260967 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.261466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.271411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.272544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:16.279087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:16.281025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:16.281849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:16.283226 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 73/148] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:16.287665 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.315655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.332435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.377449 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b22257-b6c9-4edc-ad1d-cff114d07a89 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.389591 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee14b-d6c4-438f-83ab-677b59056bcc None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.412682 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.413382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.413703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.413999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.422923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.423564 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.423846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.424117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.424405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:16.425250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.426711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.428271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 74/149] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:16.429196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:16.429301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:16.430088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:16.430847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 76/150] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:16.433911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.524200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.531432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e9ca-7fc9-4862-82e8-c8d94e4f3008 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.533102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce28b-6e93-4d68-9ad1-2bafaa2f013b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.545994 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.566542 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.566701 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.567145 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.567236 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.567424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.567513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.567733 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.567816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.568391 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.568489 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:16.568702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.569894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.570179 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.578229 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 75/151] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:16.582904 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.597568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 77/152] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:16 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:08:16.598398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.707074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910683-6314-4a88-bba5-8bc87d1619b7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.714390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769088f-5172-47f9-8a16-63364ab09041 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.750479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.751166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.751450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.751724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.752405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:16.752719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.754185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.757555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.758451 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.758931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.759398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] PATH_INFO: `/v3/users/681a0c293fc54d6c8532dc2ba37729c4` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.763463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 76/153] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:16.769057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.775431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=681a0c293fc54d6c8532dc2ba37729c4)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.776856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.778618 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 78/154] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/users/681a0c293fc54d6c8532dc2ba37729c4 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:16.784513 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.790032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.821324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:16.889544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d940-425b-438b-99bb-4145328eac8f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.912418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3414ba-3f40-47da-8ebb-f1096a83a1f4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:16.932478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.933121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.933424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.934433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] PATH_INFO: `/v3/users/681a0c293fc54d6c8532dc2ba37729c4` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.936683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] RBAC: Authorizing `identity:get_user(user_id=681a0c293fc54d6c8532dc2ba37729c4)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.937594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.939346 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 77/155] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/users/681a0c293fc54d6c8532dc2ba37729c4 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:16.945807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:16.968082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:16.969315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:16.969741 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:16.970159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:16.972909 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:16.974883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:16.976733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 79/156] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:16.983620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:17.046247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:17.059020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a449-af91-44ed-91d7-83ef36a64584 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:17.093615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:17.094507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:17.095249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:17.095689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:17.096060 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:17.097523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:17.099081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:17.100977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 78/157] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:16 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:17.102012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f5a0-1256-4605-ac12-ea6914693887 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:17.106994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:17.142013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:17.142990 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:17.143478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:17.143933 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/681a0c293fc54d6c8532dc2ba37729c4/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:17.146132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, user_id=681a0c293fc54d6c8532dc2ba37729c4, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:17.147792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0842d76-ec9d-42fd-b487-c79ba7a462f9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:17.163494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 80/158] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:16 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/681a0c293fc54d6c8532dc2ba37729c4/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:17.222974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0aa2-5ed5-4d70-bf0a-c9ba66b38a34 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:17.263386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:17.264133 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:17.264415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:17.264751 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/681a0c293fc54d6c8532dc2ba37729c4/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:17.267189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, user_id=681a0c293fc54d6c8532dc2ba37729c4, role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:17.268726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a46bab-30a3-4d48-b145-a08f4eefbe87 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:17.287304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 79/159] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:17 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/681a0c293fc54d6c8532dc2ba37729c4/roles/a3fc537dd6f9468895373cc15d975f81 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:08:18.886646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79408-bf36-4ae6-b2c8-fd404e9e6005 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:18.887212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79408-bf36-4ae6-b2c8-fd404e9e6005 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:18.887212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79408-bf36-4ae6-b2c8-fd404e9e6005 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:18.888578 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 81/160] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:18.893834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:18.894653 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:18.895146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:18.914326 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:18.915835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:18.925867 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:18.965816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e3cda-931a-4e3c-82ed-f1e27290d396 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:18.966452 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e3cda-931a-4e3c-82ed-f1e27290d396 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:18.967463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e3cda-931a-4e3c-82ed-f1e27290d396 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:18.969373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 82/161] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:18.977998 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:18.978777 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:18.979263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:18.994322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 80/162] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:19.003253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:19.004662 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:19.074760 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 83/163] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:19.264700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.363707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.379212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7c1a2-90c2-4dd2-b69c-661dcbd17357 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.415771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.416407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.416682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.416950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.427804 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3aef1dce-a025-4b66-98e4-dc3899f923d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:19.432540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:19.433501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:19.434348 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 81/164] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:19.435647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6789bb-f148-4e13-99a5-189e1cbd1e4a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.435647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6789bb-f148-4e13-99a5-189e1cbd1e4a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.436202 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6789bb-f148-4e13-99a5-189e1cbd1e4a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.441754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 82/165] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:19.441754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6789bb-f148-4e13-99a5-189e1cbd1e4a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.442455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:19.468498 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:19.489426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb956-ea94-416c-a5c7-ecc7c876d341 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.523382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.523943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.524218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.524483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.525590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:19.527034 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703553e8-751a-4d9b-9a51-d84b15cd46c8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:19.528580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 84/166] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:19.530322 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.530600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.530871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.546074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6789bb-f148-4e13-99a5-189e1cbd1e4a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.548350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:19.549558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:19.580116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.580730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.581010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.581353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.581985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:19.582291 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:19.583676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bedc70-dce7-4101-90f8-939a555a4b8b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:19.592032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 83/167] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:19.593020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac94fd-5762-4492-8e26-216230783191 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.593333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac94fd-5762-4492-8e26-216230783191 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.593606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac94fd-5762-4492-8e26-216230783191 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.594807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 84/168] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:19.595487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac94fd-5762-4492-8e26-216230783191 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.619574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 85/169] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:19.620602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.664735 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:19.704871 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac94fd-5762-4492-8e26-216230783191 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.707921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:19.725670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a337800-1c8b-4c16-acd6-c1920555a4bd None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.740695 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.741337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.741614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.741904 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.742517 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:19.743956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0454ea-017b-435a-adba-24b0d150fd35 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:19.762437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.763091 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.763395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.763667 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] PATH_INFO: `/v3/users/8db7b259f403405f843a733a81d8922e` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.773601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 85/170] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:19 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:19.773601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.773601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.773601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.779636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] RBAC: Authorizing `identity:get_user(user_id=8db7b259f403405f843a733a81d8922e)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:19.781210 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:19.783099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 86/171] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/users/8db7b259f403405f843a733a81d8922e => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:19.793654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:19.795277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:19.798195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.887858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 86/172] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:19.898598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:19.929427 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e518-906d-4f22-b7e6-a2cb6219cb0b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:19.964000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:19.972724 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:19.974018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:19.974127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:19.974342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:19.977196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:19.977859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:19.980243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 87/173] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:19.985871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.000739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.023108 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e039-32fc-47b3-9b24-d187c832ecec None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.068528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.068528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.068777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.069050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.081347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:20.086183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:20.087046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:20.087830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 87/174] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:20.097300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.122784 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd0f0-d9b1-4fc3-aa5a-230ec8f2fda0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.165506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.166356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.166765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.167605 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/8db7b259f403405f843a733a81d8922e/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.170282 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, user_id=8db7b259f403405f843a733a81d8922e, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.171830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.189185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 88/175] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:19 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/8db7b259f403405f843a733a81d8922e/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:08:20.189185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.237713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289aae-1bfc-4c9b-831a-c1ad0b8f5c86 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.250821 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.274310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.286025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.287076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.287541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.288005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.288935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:20.290236 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.292021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.302651 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 88/176] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:20.308574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.315076 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84010daa-aad4-4744-9565-0fde022e46d2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.353867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.354794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.355218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.355651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.368706 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:20.374236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:20.375368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:20.376355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:20.378380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 89/177] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:20.385450 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.462199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de57b3-1b8c-44aa-b86e-92bc1bd58f7f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.507204 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.507844 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.508128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.508400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] PATH_INFO: `/v3/users/681a0c293fc54d6c8532dc2ba37729c4` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.510491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] RBAC: Authorizing `identity:get_user(user_id=681a0c293fc54d6c8532dc2ba37729c4)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.511957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.513634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 89/178] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/users/681a0c293fc54d6c8532dc2ba37729c4 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:20.519557 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.520982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66b746-ebc8-4024-b44d-7a7a5302c176 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.558113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.565845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.566464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.566747 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.567020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.567691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:20.568002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.570050 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.571167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.582466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 90/179] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:20.589806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.650149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07434-9729-4d0e-b0a6-c46ff4640758 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.708995 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.709645 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.709925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.710189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.734580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae7f4-fbd5-4e22-a9d9-308dc23f4d57 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:20.809149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.811046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.813772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:20.815319 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:20.815603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:20.815880 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] PATH_INFO: `/v3/users/681a0c293fc54d6c8532dc2ba37729c4` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:20.820397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] RBAC: Authorizing `identity:get_user(user_id=681a0c293fc54d6c8532dc2ba37729c4)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:20.822375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:20.824729 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 91/180] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/users/681a0c293fc54d6c8532dc2ba37729c4 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:20.832369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:20.880139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.938771 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:20.979430 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e643c0-2a89-4e55-b6a4-421413262bfa None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:21.022583 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 90/181] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 04:08:21.035496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:21.049755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:21.050375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:21.050883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:21.051343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:21.129437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:21.129437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:21.197164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:21.230841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 92/182] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 04:08:21.237195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:21.286700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f988a6-33be-4da1-8822-15c8c2692356 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:21.349521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd316a-f3f6-4cf4-bc8c-a3df81678d97 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:21.385570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:21.386199 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:21.386537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:21.386814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:21.387976 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:21.389613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:21.391517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 93/183] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:21 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:21.397085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:21.406396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:21.407060 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:21.407342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:21.407619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:21.408767 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:21.410254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:21.412081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 91/184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:21 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:21.417991 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:21.431070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:21.440377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:21.508635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829047dd-7763-4d50-bf3e-1fdaeb361ab5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:21.545216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:21.545823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:21.546097 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:21.546368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:21.547085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] RBAC: Adding query filter params (role.id=a3fc537dd6f9468895373cc15d975f81, scope.project.id=8a4a7ab85b304b78980350e83a4223b1, user.id=681a0c293fc54d6c8532dc2ba37729c4) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:21.547387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:21.549415 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66cf7-2c01-4c19-bab7-b8ae33d87ab0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:21.556039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 94/185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:21 2022] GET /identity/v3/role_assignments?user.id=681a0c293fc54d6c8532dc2ba37729c4&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=a3fc537dd6f9468895373cc15d975f81 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:21.678920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5418dd-7782-46d2-bd3f-276bc30d8b98 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:21.728958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:21.729616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:21.729900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:21.730178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:21.730928 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=8a4a7ab85b304b78980350e83a4223b1, user.id=681a0c293fc54d6c8532dc2ba37729c4) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:21.731242 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:21.733305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9595e-1a11-4553-8952-f73d7710bad2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:21.746037 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 92/186] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:21 2022] GET /identity/v3/role_assignments?user.id=681a0c293fc54d6c8532dc2ba37729c4&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:22.223482 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c507b-fdbe-4dff-b748-3ebd1b1ce2ea None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.224029 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c507b-fdbe-4dff-b748-3ebd1b1ce2ea None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.224029 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c507b-fdbe-4dff-b748-3ebd1b1ce2ea None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.225535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 95/187] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:22.230684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.231064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.231222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.249939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:22.251113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:22.323186 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 93/188] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:22.584509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c507b-fdbe-4dff-b748-3ebd1b1ce2ea None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:22.685016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:22.696814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c507b-fdbe-4dff-b748-3ebd1b1ce2ea None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:22.730354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:22.730985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.731260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.731526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.741459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-0927df86-f753-4818-b92d-0bb5acf0e6fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:22.746529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:22.747418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:22.748730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:22.750055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 96/189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:22.754044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:22.756337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:22.773797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8e7d-d8ea-426f-9930-26812fe87e49 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.774085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8e7d-d8ea-426f-9930-26812fe87e49 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.774419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf8e7d-d8ea-426f-9930-26812fe87e49 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.775758 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 97/190] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:22.776761 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123afa6-f90f-451a-846b-cbe45f321cc9 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.777605 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123afa6-f90f-451a-846b-cbe45f321cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.777886 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123afa6-f90f-451a-846b-cbe45f321cc9 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.779714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 98/191] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:22.782311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad05df-89a8-40c6-9993-8d92451eade0 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.782593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad05df-89a8-40c6-9993-8d92451eade0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.782868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad05df-89a8-40c6-9993-8d92451eade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.800692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-76ad05df-89a8-40c6-9993-8d92451eade0 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:22.801911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-76ad05df-89a8-40c6-9993-8d92451eade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:22.853703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479d5d5-a2de-44b3-a895-57f2858ec309 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:22.868508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 99/192] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:22.869906 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.870192 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.870462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.889097 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:22.889268 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:22.889725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:22.890003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:22.890269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:22.890432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:22.890929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:22.891227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:22.892666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:22.900742 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 94/193] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:22.906243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:22.962663 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 100/194] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:22.970848 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.009156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bab31-7cef-469d-8e0f-0be29d6ce263 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.040975 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.041625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.041903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.042173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] PATH_INFO: `/v3/users/7d7779544f5d48fdb41991cbe467e304` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.055353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7779544f5d48fdb41991cbe467e304)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.056886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.058658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 95/195] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:22 2022] GET /identity/v3/users/7d7779544f5d48fdb41991cbe467e304 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:23.064708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.079077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.133210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.165688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006564-42d4-48d1-8930-b48af81655d7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.200963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.201618 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.201899 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.202179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.203285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.204719 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.206560 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 101/196] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:23.211920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.242920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a195-48d6-45e6-8d40-80b28ae27eb2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.265662 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.277369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.278088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.278371 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.278643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.288991 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:23.293214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:23.293833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:23.294781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:23.295582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 96/197] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:23.296237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.312377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf68b7-0107-4ca1-8fab-b4567180c3b1 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.348776 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.349471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.349768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.350309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/7d7779544f5d48fdb41991cbe467e304/roles/71f7b5e886d54387ad0234efb1a4e16e` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.352192 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, user_id=7d7779544f5d48fdb41991cbe467e304, role_id=71f7b5e886d54387ad0234efb1a4e16e)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.353945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.366283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 102/198] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:23 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/users/7d7779544f5d48fdb41991cbe467e304/roles/71f7b5e886d54387ad0234efb1a4e16e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:08:23.367074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.413554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df1efd-8628-4cd1-9b6d-2ef19d2354f6 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.453595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.454246 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.454561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.454847 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.456034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.458320 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.459215 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 97/199] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:23.464929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.490129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23bd11-a3bd-4ffd-bd1d-6cdd1a327708 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.523225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.526827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.527451 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.527735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.528008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.528681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:23.529533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.530928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.540997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 103/200] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:23.545462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.548459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.588556 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dff52-a210-4524-9575-f9e6cf408fb5 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.625277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.625892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.626177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.626448 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.627110 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.628564 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.652779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 98/201] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:23 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:08:23.657065 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ec6-da87-4224-b22e-5e64b7a83326 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.696592 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.697284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.697569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.697845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] PATH_INFO: `/v3/users/8db7b259f403405f843a733a81d8922e` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.699127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=8db7b259f403405f843a733a81d8922e)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.700588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:23.702501 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 104/202] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/users/8db7b259f403405f843a733a81d8922e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:23.708213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:23.820367 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b3d2-448e-4d84-bf1e-ac2d6a0f8200 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:23.829094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:23.864713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:23.865366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:23.865641 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:23.865910 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:23.938667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:23.940484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:24.046034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 99/203] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:24.051254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:24.126631 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:24.160423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da2dd-8b3e-454a-bebe-661971ede1f9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:24.195736 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:24.196376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:24.196653 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:24.196924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:24.198071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:24.199569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268462a-24d8-4668-adab-546923d00c43 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:24.201625 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 105/204] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:24 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:24.207183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:24.215376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:24.314113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2217c-aba8-4003-8f41-c6fbd17d37f1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:24.353903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:24.354579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:24.354869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:24.355146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:24.355879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] RBAC: Adding query filter params (role.id=3a9f5bd18c8140c89d65305279cf6577, scope.project.id=8a4a7ab85b304b78980350e83a4223b1, user.id=8db7b259f403405f843a733a81d8922e) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:24.356188 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:24.358233 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d53d-7169-4678-8e27-5ea72402f0ac None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:24.364501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 100/205] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:24 2022] GET /identity/v3/role_assignments?user.id=8db7b259f403405f843a733a81d8922e&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:25.568255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d58d34-52b5-4f2f-ac5b-f5a570aeccf2 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:25.568768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d58d34-52b5-4f2f-ac5b-f5a570aeccf2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:25.568768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d58d34-52b5-4f2f-ac5b-f5a570aeccf2 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:25.570202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 106/206] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:25.575513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd81f-a2d1-488a-b5b5-2a4241bf153f None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:25.576407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd81f-a2d1-488a-b5b5-2a4241bf153f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:25.576609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd81f-a2d1-488a-b5b5-2a4241bf153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:25.594942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-1f5bd81f-a2d1-488a-b5b5-2a4241bf153f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:25.596057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-1f5bd81f-a2d1-488a-b5b5-2a4241bf153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:25.660919 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:25.666277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 101/207] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:25.938646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d58d34-52b5-4f2f-ac5b-f5a570aeccf2 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.008998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634f38a-48cb-4d58-88a6-a91991cdc5f5 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.009367 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634f38a-48cb-4d58-88a6-a91991cdc5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.009590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634f38a-48cb-4d58-88a6-a91991cdc5f5 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.011071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 102/208] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:26.016393 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.016680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.016958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.034601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:26.035774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:26.048073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d58d34-52b5-4f2f-ac5b-f5a570aeccf2 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.081432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.082063 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.082345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.082619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.089279 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.093875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e2c5d942-42bc-4c5f-b6dc-0cc231ead1ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:26.098836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:26.099737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:26.100612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 107/209] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:26.101301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b9d1-d86d-42bb-a3d5-aa33f5a6feae None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.101366 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b9d1-d86d-42bb-a3d5-aa33f5a6feae None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.101885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690b9d1-d86d-42bb-a3d5-aa33f5a6feae None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.102560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:26.102998 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 108/211] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:26.105937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.108806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.109087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.109384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.127051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:26.128207 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:26.206926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 109/212] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:26.212708 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a23938-5cf6-4972-8fcc-e27ada629a67 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.241639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.248601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.249253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.249531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.249808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.250484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:26.250784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.252173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.260513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 104/213] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:26.266070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.369281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.374223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b4e3-74f1-4448-9e5d-e77af2047e4c None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.403705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.412594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.413268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.413550 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.413830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] PATH_INFO: `/v3/users/7d7779544f5d48fdb41991cbe467e304` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.414946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] RBAC: Authorizing `identity:get_user(user_id=7d7779544f5d48fdb41991cbe467e304)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.416385 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.418036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 110/214] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/users/7d7779544f5d48fdb41991cbe467e304 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:26.423402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.476577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace8ff-06b0-4154-85e6-a73dfc5e6386 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.509476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.510111 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.510393 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.510668 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.520435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:26.524130 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8366-1591-40d4-bbb6-ba230b10cf0e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:26.525725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:26.526588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:26.527366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 105/215] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:26.528039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.559713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.560834 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.561109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.561409 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.580623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.620674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.627883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d2d5a-533e-458f-9c5e-cda2e5ce1bc3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.630039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.631701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.661436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.662064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.662347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.662623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.663728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.665219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.666837 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 106/216] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:26.667644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.730674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 111/217] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 04:08:26.736038 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.764866 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3232c8-8857-4d44-a8ce-561a61b7d2f4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.783336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.797292 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.797902 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.798176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.798444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.799104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:26.799404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.800768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.808480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 107/218] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:26.809332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.829563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:26.836342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98bc4f-dccd-47ba-800e-c4e5b5d6a83c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.869692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.870292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.870569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.870838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.871476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.872966 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.893770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 112/219] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:26 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:26.894708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:26.910748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f638-ff19-4553-8a00-57bc560997bb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:26.949728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:26.950393 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:26.950708 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:26.950985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:26.952212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:26.953777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:26.955707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 108/220] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:26.961611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:27.015893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:27.032885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232aa28-69fe-4ffa-8b9a-b823deeff668 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:27.070120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8129ce-f04d-4d7b-b8bb-1dbe00f1ced8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:27.076478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:27.077122 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:27.077422 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:27.077981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] PATH_INFO: `/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:27.094136 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] RBAC: Authorizing `identity:get_user(user_id=cecffb0b3a184cd5bcdaaf66205f5d29)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:27.096100 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:27.097457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 113/221] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:27.103108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:27.110072 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:27.110690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:27.110971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:27.111252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:27.111985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] RBAC: Adding query filter params (role.id=71f7b5e886d54387ad0234efb1a4e16e, scope.project.id=8a4a7ab85b304b78980350e83a4223b1, user.id=7d7779544f5d48fdb41991cbe467e304) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:27.112298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:27.113915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e777-a1bf-4641-b389-4007425ce8df None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:27.116229 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:27.124915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 109/222] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:08:26 2022] GET /identity/v3/role_assignments?user.id=7d7779544f5d48fdb41991cbe467e304&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=71f7b5e886d54387ad0234efb1a4e16e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:27.221701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df36bb-3f83-4530-a3a5-e6d41b076d6e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:27.263009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:27.263714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:27.264114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:27.264395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:27.265164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] RBAC: Adding query filter params (role.id=3a9f5bd18c8140c89d65305279cf6577, user.id=cecffb0b3a184cd5bcdaaf66205f5d29, scope.system=all) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:27.265478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:27.266998 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea6d0-a039-484d-adf6-20d10425f8f6 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:27.273023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 114/223] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Oct 13 04:08:27 2022] GET /identity/v3/role_assignments?user.id=cecffb0b3a184cd5bcdaaf66205f5d29&scope.system=all&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:29.190022 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02d78-a81f-40b0-8028-870839948518 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.190588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02d78-a81f-40b0-8028-870839948518 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.190588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02d78-a81f-40b0-8028-870839948518 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.191930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 110/224] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:29.197081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06904b8-de7c-4c83-875d-9b5ea5e2191c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.197504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06904b8-de7c-4c83-875d-9b5ea5e2191c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.197665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06904b8-de7c-4c83-875d-9b5ea5e2191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.216242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b06904b8-de7c-4c83-875d-9b5ea5e2191c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:29.218109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b06904b8-de7c-4c83-875d-9b5ea5e2191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:29.253526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b3-090c-4ef0-9213-763b69509fc5 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.253807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b3-090c-4ef0-9213-763b69509fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.254081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c0b3-090c-4ef0-9213-763b69509fc5 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.255538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 111/225] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:29.260119 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84af49-80ff-4fc5-a03a-61256ed462b7 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.260409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84af49-80ff-4fc5-a03a-61256ed462b7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.260682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84af49-80ff-4fc5-a03a-61256ed462b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.278900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-fb84af49-80ff-4fc5-a03a-61256ed462b7 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:29.280048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-fb84af49-80ff-4fc5-a03a-61256ed462b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:29.288216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 115/226] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:29.355447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 112/227] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:29.423203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951c09-2976-47df-962e-e384a5c1aac7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.423535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951c09-2976-47df-962e-e384a5c1aac7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.423752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d951c09-2976-47df-962e-e384a5c1aac7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.425271 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 116/228] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:29.430217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.430503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.430776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.448641 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:29.449771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:29.490727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:29.517121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 113/229] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:29.562947 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d951c09-2976-47df-962e-e384a5c1aac7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.566765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:29.627572 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.668627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d951c09-2976-47df-962e-e384a5c1aac7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:29.703526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:29.704175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.704464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.704738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.715945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:29.721562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:29.722447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:29.723256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 117/230] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:29.728548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.740290 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb79133-3999-4c6f-8483-989f5e05586a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:29.775646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:29.776305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.776586 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.776862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.777987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:29.779466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:29.781213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 114/231] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:29.782562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.796502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:29.827431 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:29.834849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5511-fc0d-46ba-907a-51d52cc3082f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:29.868546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:29.869185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.869468 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.869742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.870410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:29.870715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:29.872104 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:29.880620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 118/232] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:29.881416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.888494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5208-30fd-40ad-99fc-c20638138df6 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:29.923856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:29.924838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:29.925326 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:29.925670 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:29.937426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:29.942876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:29.943807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:29.944568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 115/233] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:29.945238 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:29.989500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37558-89f2-4563-9478-a3f29504bcfc None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.014211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:30.023058 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.023665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.023946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.024216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] PATH_INFO: `/v3/groups` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.024841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.026312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.045309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 119/234] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Oct 13 04:08:29 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:30.045309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:30.045539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f76f4-7578-4ea3-81cd-9131ef82f478 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.045539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:30.084932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.085609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.085934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.086207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] PATH_INFO: `/v3/users/a41f9ddb653a428da586b4387cbad34c` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.102061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] RBAC: Authorizing `identity:get_user(user_id=a41f9ddb653a428da586b4387cbad34c)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.103880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.105676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 116/235] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:29 2022] GET /identity/v3/users/a41f9ddb653a428da586b4387cbad34c => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:30.112030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:30.159898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d9c1-21cf-448c-b9c2-d3cf23c7306a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.199646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.200306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.200570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.200921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.201627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:30.201932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.203555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.214053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 120/236] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:30.219665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:30.220277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa70-a461-4477-81c0-87dc59e5df61 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.259335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.259869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.260148 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.260417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.261163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] RBAC: Adding query filter params (role.id=71f7b5e886d54387ad0234efb1a4e16e, user.id=a41f9ddb653a428da586b4387cbad34c, scope.system=all) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:30.261558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.262933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.268955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 117/237] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Oct 13 04:08:30 2022] GET /identity/v3/role_assignments?user.id=a41f9ddb653a428da586b4387cbad34c&scope.system=all&role.id=71f7b5e886d54387ad0234efb1a4e16e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:30.276184 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:30.340132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f3eb-4396-4d2c-a6fe-a8bd99f0372a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.379374 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.380021 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.380312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.380566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] PATH_INFO: `/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.381738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] RBAC: Authorizing `identity:get_user(user_id=cecffb0b3a184cd5bcdaaf66205f5d29)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.383221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23437fde-aebf-4aa2-935e-13959066b2ae None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.385054 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 121/238] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:30 2022] GET /identity/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:30.390710 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:30.419045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:30.499383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0577-1f74-48b7-87e4-8ec75622d527 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:30.533774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:30.534351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:30.534631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:30.534905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] PATH_INFO: `/v3/system/users/cecffb0b3a184cd5bcdaaf66205f5d29/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:30.536300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cecffb0b3a184cd5bcdaaf66205f5d29, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:30.537706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deae40-8ad0-4723-bdbb-fce63d3bcbca None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:30.552127 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 118/239] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Oct 13 04:08:30 2022] PUT /identity/v3/system/users/cecffb0b3a184cd5bcdaaf66205f5d29/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:08:32.236872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3823-91f2-4a0a-a4fa-0adca05539ef None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.237424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3823-91f2-4a0a-a4fa-0adca05539ef None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.237498 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3823-91f2-4a0a-a4fa-0adca05539ef None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.238953 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 122/240] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:32.243979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7fa1-7a5a-4e3a-8326-e5ebff000bf1 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.244372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7fa1-7a5a-4e3a-8326-e5ebff000bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.244528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7fa1-7a5a-4e3a-8326-e5ebff000bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.262355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-2d9a7fa1-7a5a-4e3a-8326-e5ebff000bf1 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:32.264076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2d9a7fa1-7a5a-4e3a-8326-e5ebff000bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:32.342130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 119/241] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:32.405630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1ee4-d831-4c33-b55b-1e848d6fd7c7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.405928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1ee4-d831-4c33-b55b-1e848d6fd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.406181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1ee4-d831-4c33-b55b-1e848d6fd7c7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.407657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 123/242] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:32.412525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1e8-5a6b-40bc-be9d-a0854f955f08 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.412815 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1e8-5a6b-40bc-be9d-a0854f955f08 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.413090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1e8-5a6b-40bc-be9d-a0854f955f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.431901 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-451fe1e8-5a6b-40bc-be9d-a0854f955f08 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:32.433078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-451fe1e8-5a6b-40bc-be9d-a0854f955f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:32.445998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:32.501476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 120/243] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:32.612664 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1ee4-d831-4c33-b55b-1e848d6fd7c7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:32.663153 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48dc8-df17-4abf-b084-116d1d89dfd7 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.663487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48dc8-df17-4abf-b084-116d1d89dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.663712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48dc8-df17-4abf-b084-116d1d89dfd7 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.665065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 121/244] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:32.670505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.670786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.671056 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.690249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:32.691749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:32.715794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1ee4-d831-4c33-b55b-1e848d6fd7c7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:32.732886 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:32.752753 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:32.753336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.753618 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.753891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.754973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:32.756413 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:32.757997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 124/245] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:32.764007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:32.765509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 122/246] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:32.774107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:32.859634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:32.871582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48a63-e69a-45b7-acc7-2c65a20c29c9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:32.886467 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77d748-faa9-4535-a3d5-a832c19adcd9 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:32.907164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:32.907773 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.908055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.908329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] PATH_INFO: `/v3/groups` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.908952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:32.910419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:32.925216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:32.926036 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:32.926193 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:32.926458 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:32.930585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 125/247] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Oct 13 04:08:32 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:08:32.947814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:32.952934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:32.953953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:32.957093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 123/248] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:32.960304 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.011664 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:33.039626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.076203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68551115-47ea-464c-a69f-d5757c7cb14a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.113780 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.114402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.114684 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.114956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.115637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:33.115940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.117345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.126177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 126/249] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:33.132584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.156248 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610eda-bbb6-4e3a-a602-8b06162229eb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.201327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.201967 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.202248 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.202510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.220147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:33.225935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:33.231401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:33.232861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:33.233738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 124/250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:33.238654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.256418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4df51-573c-4f60-9965-5bda061172bb None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.264926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:33.303639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.304281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.305003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.305345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] PATH_INFO: `/v3/users/a41f9ddb653a428da586b4387cbad34c` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.306696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] RBAC: Authorizing `identity:get_user(user_id=a41f9ddb653a428da586b4387cbad34c)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.308230 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.310749 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 127/251] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:33 2022] GET /identity/v3/users/a41f9ddb653a428da586b4387cbad34c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:33.316718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.371957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471640a4-6d03-4006-a7a7-3b78e2db04fb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.411520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.412118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.412397 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.412667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.413375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:33.413677 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.415146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.425536 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 125/252] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:33.430208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.453323 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56031c7b-71f5-4526-bc0a-641e55ee8703 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.503007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.504288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.505026 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.505587 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] PATH_INFO: `/v3/system/users/a41f9ddb653a428da586b4387cbad34c/roles/71f7b5e886d54387ad0234efb1a4e16e` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.507883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a41f9ddb653a428da586b4387cbad34c, role_id=71f7b5e886d54387ad0234efb1a4e16e)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.509451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:33.511550 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.525934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 128/253] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Oct 13 04:08:33 2022] PUT /identity/v3/system/users/a41f9ddb653a428da586b4387cbad34c/roles/71f7b5e886d54387ad0234efb1a4e16e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:33.565770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafe48-a324-4e1b-b2e5-fc1edb6b9496 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.608939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.609772 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.610107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.610394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] PATH_INFO: `/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.611731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cecffb0b3a184cd5bcdaaf66205f5d29)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.613353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff91c8-a9b1-4390-9770-768b0f2ae4a7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.615190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 126/254] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:33 2022] GET /identity/v3/users/cecffb0b3a184cd5bcdaaf66205f5d29 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:33.621168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:33.677987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:33.756661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa252ee-ff5e-4fb6-a367-022908f5e688 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:33.793177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:33.793743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:33.794029 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:33.794830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:33.795636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] RBAC: Adding query filter params (role.id=3a9f5bd18c8140c89d65305279cf6577, user.id=cecffb0b3a184cd5bcdaaf66205f5d29, scope.system=all) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:33.795951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:33.797544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9c8b-2c48-4ca7-9bdf-90ba72a75886 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:33.810343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 129/255] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Oct 13 04:08:33 2022] GET /identity/v3/role_assignments?user.id=cecffb0b3a184cd5bcdaaf66205f5d29&scope.system=all&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:35.526882 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc10f-0080-4930-b155-4d37b142396f None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:35.527385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc10f-0080-4930-b155-4d37b142396f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:35.527488 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fc10f-0080-4930-b155-4d37b142396f None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:35.529353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 127/256] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:35.534919 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:35.535803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:35.536279 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:35.552671 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9df2-ba17-4256-992c-532ca9b117d7 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:35.553306 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9df2-ba17-4256-992c-532ca9b117d7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:35.553801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a9df2-ba17-4256-992c-532ca9b117d7 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:35.555330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 128/257] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:35.560686 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476023af-1999-43c8-9634-7c72add28961 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:35.561260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476023af-1999-43c8-9634-7c72add28961 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:35.561734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476023af-1999-43c8-9634-7c72add28961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:35.584381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:35.586034 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:35.598208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-476023af-1999-43c8-9634-7c72add28961 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:35.601861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-476023af-1999-43c8-9634-7c72add28961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:35.723970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 130/258] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 04:08:35.733525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 129/259] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 04:08:36.013864 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.023395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e7d6-1b18-499a-ab8f-8dae8fa48ce6 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.028172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.029205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.029689 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.030174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.041104 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-b839d2c0-784c-43c5-ab84-4452b313f632 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:36.047353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:36.048196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:36.048975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:36.051222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 131/260] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:36.067161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476023af-1999-43c8-9634-7c72add28961 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.082174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476023af-1999-43c8-9634-7c72add28961 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.087335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.088178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.088657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.089160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.090040 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:36.090577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.092679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING py.warnings [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:36.092679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: warnings.warn(msg) Oct 13 04:08:36.092679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: Oct 13 04:08:36.098010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.102477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7f88-05ab-4654-bc41-2c6a54bf2afd None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.102766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7f88-05ab-4654-bc41-2c6a54bf2afd None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.103046 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7f88-05ab-4654-bc41-2c6a54bf2afd None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.104955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 132/261] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:36.111962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.112250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.112525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.114886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 130/262] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:36.120479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.131001 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e61128-9fa4-4012-8af7-458be6647507 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.141406 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.142372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.142852 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.143324 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.145003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:36.146351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:36.154446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.155803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING py.warnings [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:36.155803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: warnings.warn(msg) Oct 13 04:08:36.155803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: Oct 13 04:08:36.157395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.159608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 131/263] 10.222.0.13 () {56 vars in 1201 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:36.164971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.178924 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb75eb-17ff-4a05-9570-3cb0129e8784 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.191416 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.192065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.192341 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.192614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.194427 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:36.194540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.196573 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.199511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 132/264] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:36.204058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.217253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2020eb-07d9-4bdc-ae30-67cfb1ada8d7 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.221787 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.222444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.222723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.222998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/groups/4e02d456d7214409b96be7bc087179f2/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.225205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, group_id=4e02d456d7214409b96be7bc087179f2, role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.226241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING py.warnings [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:36.226241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: warnings.warn(msg) Oct 13 04:08:36.226241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: Oct 13 04:08:36.228262 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.250330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 133/265] 10.222.0.13 () {58 vars in 1463 bytes} [Thu Oct 13 04:08:36 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/groups/4e02d456d7214409b96be7bc087179f2/roles/a3fc537dd6f9468895373cc15d975f81 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:36.252347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.284691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 133/266] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:36.337487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:36.354935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fdb11-8c25-46e2-9acc-efe8a68a8076 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.366721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.367378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.367654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.367926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.382840 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:36.387914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:36.388838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:36.389682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 134/267] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:36.395245 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.408492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdf075-ef3b-402b-8011-c9bf5ab595f7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.414765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.415503 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.415782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.416053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.416791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:36.417101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.419078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:36.419078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:08:36.419078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:08:36.420056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.437556 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 134/268] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:36.443344 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.456041 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549485-d7e6-4083-82f5-d8f83b1ac446 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.467560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.468268 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.468550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.468822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.470015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.472074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.473745 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 135/269] 10.222.0.13 () {56 vars in 1201 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:36.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.491686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54011-a6b0-4953-b9e8-9196bab957aa admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.499872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.500535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.500860 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.501159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.502364 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.504624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.506342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 135/270] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:36.512383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.523510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25699715-3531-4d2a-b235-677ab13553e9 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.528594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.529342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.529624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.529953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81/groups/4e02d456d7214409b96be7bc087179f2/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:36.531925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319ecf7437db4713a62636cc599d9f81, group_id=4e02d456d7214409b96be7bc087179f2, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:36.534887 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:36.565861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 136/271] 10.222.0.13 () {58 vars in 1463 bytes} [Thu Oct 13 04:08:36 2022] PUT /identity/v3/projects/319ecf7437db4713a62636cc599d9f81/groups/4e02d456d7214409b96be7bc087179f2/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:36.841325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:36.955958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436680c5-d803-4c76-ba2c-3578cda950fe admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:36.998236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:36.998872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:36.999152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:36.999423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.018047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-3adc538a-ef9e-4cff-95c4-a5533df9bc01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:37.023538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:37.024402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:37.025209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 136/272] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:37.031123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.088360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72cce-8870-4868-9968-d8f5f82c509a None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.088697 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72cce-8870-4868-9968-d8f5f82c509a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.088914 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72cce-8870-4868-9968-d8f5f82c509a None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.090287 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 137/273] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:37.097055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.097313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.097574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.125356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:37.138219 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:37.139442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:37.168253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d9294-b3a5-4700-a92c-f015d4ecef87 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.229772 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.230395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.230678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.230952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.231670 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:37.232010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.233533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.252596 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 137/274] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:37.258663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.295303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 138/275] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 04:08:37.305501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:37.429234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb0e33-1523-4053-aa20-dd5369afd38b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.473823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.474462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.474744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.475018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] PATH_INFO: `/v3/users/a41f9ddb653a428da586b4387cbad34c` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.476159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] RBAC: Authorizing `identity:get_user(user_id=a41f9ddb653a428da586b4387cbad34c)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.477633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.479784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 138/276] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/users/a41f9ddb653a428da586b4387cbad34c => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:37.485850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.603539 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261cfb-bc18-409d-aee1-d1ed9d4b7772 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.646740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.647360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.647645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.647924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.648655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] RBAC: Adding query filter params (role.id=71f7b5e886d54387ad0234efb1a4e16e, user.id=a41f9ddb653a428da586b4387cbad34c, scope.system=all) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:37.648963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.650439 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.668223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 139/277] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/role_assignments?user.id=a41f9ddb653a428da586b4387cbad34c&scope.system=all&role.id=71f7b5e886d54387ad0234efb1a4e16e => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:37.747814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.763511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a050-04d4-476f-a0e1-3bfd9a97a517 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.769709 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.770386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.770666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.770942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.793141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:37.798376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:37.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:37.800103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:37.800698 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 139/278] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:37.805459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.830275 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a706c-9d52-4363-87fb-a50257ea9108 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.835429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.836338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.836851 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.837392 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.838275 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:37.838783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.840622 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.854289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:37.861474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 140/279] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:37.864600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.880958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362cfdb-716d-4646-a100-7bb7eae69541 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.890144 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.890869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.891150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.891483 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.892683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.894719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745da84f-9ed2-403d-a073-5e64e721be86 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.899886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 140/280] 10.222.0.13 () {56 vars in 1201 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:37.903386 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.909845 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aa5d-22b8-4aad-b56b-8ac5df202719 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.910430 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aa5d-22b8-4aad-b56b-8ac5df202719 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.910909 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75aa5d-22b8-4aad-b56b-8ac5df202719 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.912818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 141/281] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:37.918504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.918792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.919091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.922787 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42dc1-0666-4e7e-a9fc-97056a9155a7 admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.931324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.932310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.932795 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.933313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.934670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.937518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:37.939441 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 141/282] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:08:37 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:37.945827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:37.947441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:37.949622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:37.957707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 142/283] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 04:08:37.958523 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe33bcc-9971-48e9-9890-c638218652ea admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:37.973816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:37.974768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:37.975229 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:37.975678 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/groups/4e02d456d7214409b96be7bc087179f2/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:37.977855 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, group_id=4e02d456d7214409b96be7bc087179f2, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:37.979389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:37.979389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:08:37.979389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:08:37.981752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:38.004132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 142/284] 10.222.0.13 () {58 vars in 1463 bytes} [Thu Oct 13 04:08:37 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/groups/4e02d456d7214409b96be7bc087179f2/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 04:08:38.448492 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:38.458343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dae0-4bbb-4dce-9443-15847d1004d4 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:38.529857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:38.530509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.530839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.531109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.542270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-441376b7-d4cd-463a-971b-5ec291be4ad1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:38.547192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:38.548080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:38.548868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 143/285] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:08:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:38.554306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:38.557477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44447e0-6886-4981-a735-db1566de7513 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.557759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44447e0-6886-4981-a735-db1566de7513 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.558031 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44447e0-6886-4981-a735-db1566de7513 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.559356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 144/286] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:38.565806 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.566087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.566359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.574260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b932c1-fe1d-4775-99d0-5d1c25855e6f admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:38.582268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:38.583202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.583687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.584164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.585053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:38.585580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:38.587489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:38.591491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:38.592681 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:38.598823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 143/287] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Oct 13 04:08:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:38.607066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 145/288] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 04:08:38.609225 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:38.622843 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11615e-4ec2-4041-bfee-e3569ad8621e admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:38.628348 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:38.629267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.629755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.630244 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.631567 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:38.632791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:08:38.632791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:08:38.632791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:08:38.634354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:38.636121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 144/289] 10.222.0.13 () {56 vars in 1201 bytes} [Thu Oct 13 04:08:38 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:38.641977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:38.651715 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99196-4a97-4a3b-aee9-a495d1f91388 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:38.656679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:38.657340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.657616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.657885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.659875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:38.661986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:38.663854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:08:38 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:38.669552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:38.682415 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93187d69-9f04-4d6a-95c6-beaf881fd1a8 admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:38.690214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:38.691221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:38.691703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:38.692204 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1/groups/4e02d456d7214409b96be7bc087179f2/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:38.694771 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a7ab85b304b78980350e83a4223b1, group_id=4e02d456d7214409b96be7bc087179f2, role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:38.697855 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:38.722531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 145/291] 10.222.0.13 () {58 vars in 1463 bytes} [Thu Oct 13 04:08:38 2022] PUT /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1/groups/4e02d456d7214409b96be7bc087179f2/roles/a3fc537dd6f9468895373cc15d975f81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:39.090711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:39.096369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:39.102455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d471968-5edd-4709-8a9d-63f34445a59a admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:39.169911 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:39.170549 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.170822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.171089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.182277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:39.187624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:39.188485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:39.189373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 147/292] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:39.194921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:39.205671 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1239da-22b0-4a8d-b557-c517f8688ac1 admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:39.211033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:39.211865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.212369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.212862 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.213722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:39.214236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:39.216532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:39.226178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:39.232439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:39.243404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5313e0-15d7-48e3-a015-bb71fd3b030b admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:39.248807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:39.249698 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.250149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.250593 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] PATH_INFO: `/v3/groups/e54042084042470889f699e490acc01b` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.256300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] RBAC: Authorizing `identity:get_group(group_id=e54042084042470889f699e490acc01b)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:39.258615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:39.260759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1201 bytes} [Thu Oct 13 04:08:39 2022] GET /identity/v3/groups/e54042084042470889f699e490acc01b => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:39.266641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:39.277283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f4a63-77e5-4419-ade1-9c42b50d993c admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:39.282638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:39.283711 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.284163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.284656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] PATH_INFO: `/v3/projects/943bb932238542588166ff5bb66e3c95` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.286050 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] RBAC: Authorizing `identity:get_project(project_id=943bb932238542588166ff5bb66e3c95)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:39.288087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901f46-73e2-4958-b3ad-7844287b9860 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:39.289955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 147/295] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Oct 13 04:08:39 2022] GET /identity/v3/projects/943bb932238542588166ff5bb66e3c95 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:39.296169 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:39.306907 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189208-cc86-4e72-adf2-3aff9795050e admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:39.318213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:39.319165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.319658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.320121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] PATH_INFO: `/v3/projects/943bb932238542588166ff5bb66e3c95/groups/e54042084042470889f699e490acc01b/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.322377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=943bb932238542588166ff5bb66e3c95, group_id=e54042084042470889f699e490acc01b, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:39.331082 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423746-7ead-46da-987f-25793f5328ba admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:39.348426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1463 bytes} [Thu Oct 13 04:08:39 2022] PUT /identity/v3/projects/943bb932238542588166ff5bb66e3c95/groups/e54042084042470889f699e490acc01b/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:39.608528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f6aa-f6d8-45d1-9b1d-dbea58062e53 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.608864 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f6aa-f6d8-45d1-9b1d-dbea58062e53 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.609038 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f6aa-f6d8-45d1-9b1d-dbea58062e53 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.610403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 148/297] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:39.616174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.616693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.617210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.640088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:39.641729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:39.678052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923725-59ee-4d81-bc34-970492602e32 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.678357 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923725-59ee-4d81-bc34-970492602e32 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.678612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923725-59ee-4d81-bc34-970492602e32 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.680261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 149/298] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:39.685789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:39.686075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:39.686355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:39.722233 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:39.723446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:39.723553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 150/299] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:39.797818 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 150/300] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:40.046543 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.104713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:40.158308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef17e15-1fe3-45af-84c7-917d3bcf2701 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.192752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.193463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.193747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.194017 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.204320 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:40.209269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:40.210161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:40.211134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 151/301] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:40.218481 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.293478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:40.333380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dcd0d-50f3-4d36-8513-ae81522b9249 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.363193 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.389769 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.390386 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.390664 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.390935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.391603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] RBAC: Adding query filter params (name=member) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:40.391901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:40.393311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:40.414379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 151/302] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:40.418828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.547981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f52dd-0e6c-473b-ba02-939b3418125c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.569003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee890d-ee15-4608-9e30-64a9721c59e9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.583983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.584564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.584849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.585116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.604808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:40.613551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:40.650224 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.650888 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.651170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.651449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.663207 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:40.664735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:40.675168 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:40.680084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:40.680944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:40.681760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:40.689574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 152/303] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:40.695850 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.770961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 152/304] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:40.776804 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.837613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:40.885993 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8b54-dc48-4160-af50-fca612a609fb None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.895067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fc5f-6eb4-49f0-822b-0d77a67d3c71 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:40.939198 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.940111 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.940491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.940862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.941693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:40.942091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:40.943621 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:40.954449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 153/305] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:40.957847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:40.958594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:40.959802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:40.960773 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:40.961047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:40.964047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:40.965546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:40.968912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 153/306] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:40.974465 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:41.025510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:41.100710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc821a-7374-4e77-a870-f5fb709ef8d0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:41.105081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:41.157053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751491-7aa7-4d08-9b5e-e9a1b2f3106a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:41.172178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:41.172826 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.173101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.173398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.174507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:41.175946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:41.177879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 154/307] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:41.183932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:41.241341 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:41.241956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.242230 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.242497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.348841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2fec-0391-42e6-b876-9a1b6936468f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:41.360810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:41.362640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9b4d-e5a7-418a-9838-e63a321c8499 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:41.395077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:41.396115 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.396624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.397033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.397908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] RBAC: Adding query filter params (group.id=4e02d456d7214409b96be7bc087179f2, role.id=3a9f5bd18c8140c89d65305279cf6577, scope.project.id=319ecf7437db4713a62636cc599d9f81) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:41.398355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:41.399939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9090a-e37b-430e-9006-0fed2cbf91fe None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:41.409492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 155/308] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Oct 13 04:08:41 2022] GET /identity/v3/role_assignments?group.id=4e02d456d7214409b96be7bc087179f2&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:41.410390 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:41.412172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532958-045f-4de9-900a-a86690bedfe0 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.412826 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532958-045f-4de9-900a-a86690bedfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.415045 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532958-045f-4de9-900a-a86690bedfe0 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.416014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 156/309] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:41.422852 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.423358 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.423770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.449428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:41.451049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:41.512343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:41.562948 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 157/310] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:41.588354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 154/311] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:41.594529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:41.673014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961abf-4d14-4cac-ba80-92136194b4fe None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.673376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961abf-4d14-4cac-ba80-92136194b4fe None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.673606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961abf-4d14-4cac-ba80-92136194b4fe None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.675091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 155/312] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:41.680229 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.680519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.680791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.704274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:41.705492 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:41.719121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049b1d-28f1-460a-adc0-58b8468282df None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:41.764063 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:41.765152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.765438 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.765715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] PATH_INFO: `/v3/projects/319ecf7437db4713a62636cc599d9f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.767137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] RBAC: Authorizing `identity:get_project(project_id=319ecf7437db4713a62636cc599d9f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:41.768590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:41.772165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 158/313] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:41 2022] GET /identity/v3/projects/319ecf7437db4713a62636cc599d9f81 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:41.778069 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:41.789725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 156/314] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:41.821093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:41.890437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c307bd-ffa2-46b6-a757-f5bc148b1783 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:41.926648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:41.927158 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:41.927281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:41.927473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:41.927750 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:41.928879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:41.930365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:41.932133 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 159/315] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Oct 13 04:08:41 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:41.938430 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.003744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.047208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d34ba-02c5-40f9-aebd-a26b7ad0d060 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.050017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c88e2-addb-4210-934e-515384ae69a9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.052437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.090392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.090911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.091556 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.091869 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.092129 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.092230 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.092700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.092883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] RBAC: Adding query filter params (group.id=4e02d456d7214409b96be7bc087179f2, role.id=a3fc537dd6f9468895373cc15d975f81, scope.project.id=319ecf7437db4713a62636cc599d9f81) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:42.093177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.093544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.094813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.105042 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:42.108640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 160/316] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Oct 13 04:08:41 2022] GET /identity/v3/role_assignments?group.id=4e02d456d7214409b96be7bc087179f2&scope.project.id=319ecf7437db4713a62636cc599d9f81&role.id=a3fc537dd6f9468895373cc15d975f81 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:42.111257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:42.113579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:42.114477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 04:08:42.115252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:42.116331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 157/317] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:42.123006 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.273624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904667-19f6-4c0e-9c6d-241b8b9415ba None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.278677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5cfe-5253-4718-bc29-f8a650fd6f05 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.305005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.316766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.317439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.317854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.318027 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.318658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] RBAC: Adding query filter params (name=member) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:42.319927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.321898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1e876-7f73-49d1-be17-3f941d18ffbf None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.335657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 158/318] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:42.337784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efe55-971b-46f5-8fe5-d38b4cad4dfd None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.337784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efe55-971b-46f5-8fe5-d38b4cad4dfd None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.337784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5efe55-971b-46f5-8fe5-d38b4cad4dfd None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.338022 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 159/319] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:42.343450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5efe55-971b-46f5-8fe5-d38b4cad4dfd None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.349963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-bd6ff7a7-0e7e-416e-8ad6-94ca23a31bbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:42.356108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:42.357099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:42.358020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:42.358636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 161/320] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:42.360464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.360464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.360464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.385247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:42.386568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:42.411420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.468317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5efe55-971b-46f5-8fe5-d38b4cad4dfd None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.470487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 162/321] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:42.470708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.513123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.513766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.514047 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.514319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.582245 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.590100 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d7a5-e2d3-4d75-a65a-5e69e7a4e1d5 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.604221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.605725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.630300 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.630907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.631473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.631473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.632083 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:42.632381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.634042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.645173 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 163/322] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:42.651628 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.675913 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.738540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 160/323] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 04:08:42.744318 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.787258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebc928-83bb-472e-a254-82c0c739a791 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.829588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.830317 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.830663 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.831002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.848782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:42.871370 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaec29-f19b-4c42-bcff-2f08aed13ec8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:42.908997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:42.909895 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:42.910820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:42.910820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:42.911638 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.913089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.914985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:42.915107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 161/324] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:42.915600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:42.918627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:42.940250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.033390 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72a6a2-dd96-4756-9a0c-ae7d5f2896a8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.039949 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 164/325] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 04:08:43.040665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.073873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.074519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.074801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.075309 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.088924 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:43.094803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:43.095684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:43.096485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 162/326] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:43.097156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.114938 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.173268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646d2f-c74c-4bd4-b987-f1fed0fe8939 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.194332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.217837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.218623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.218909 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.219242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.220170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d276e9-b6ac-47eb-aa0f-656bb3ba2e77 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.220423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.222080 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.224496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 165/327] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.225307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.260432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.261083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.261527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.261806 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] PATH_INFO: `/v3/projects/8a4a7ab85b304b78980350e83a4223b1` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.264098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] RBAC: Authorizing `identity:get_project(project_id=8a4a7ab85b304b78980350e83a4223b1)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.265597 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.267220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 163/328] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/projects/8a4a7ab85b304b78980350e83a4223b1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.267989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.346897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30719fd-45bf-46c2-b185-92a4f4ea1c36 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.361688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.380054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c46d5-6fb6-463d-9085-950b6e5688db None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.382051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.382656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.382925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.383190 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.383843 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:43.384142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.385518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.393582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 166/329] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.394359 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.417849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.418454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.418732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.419514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.420234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] RBAC: Adding query filter params (group.id=4e02d456d7214409b96be7bc087179f2, role.id=3a9f5bd18c8140c89d65305279cf6577, scope.project.id=8a4a7ab85b304b78980350e83a4223b1) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:43.420535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.421996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.427669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 164/330] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/role_assignments?group.id=4e02d456d7214409b96be7bc087179f2&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=3a9f5bd18c8140c89d65305279cf6577 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.428468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.445355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.505678 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc3702-2398-409b-97aa-fafc0d0a3756 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.545690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ee143-11ab-471c-a9d6-1f75d754113e None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.546309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.546964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.547251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.547526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] PATH_INFO: `/v3/groups/4e02d456d7214409b96be7bc087179f2` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.548674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] RBAC: Authorizing `identity:get_group(group_id=4e02d456d7214409b96be7bc087179f2)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.550257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.551906 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 167/331] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/groups/4e02d456d7214409b96be7bc087179f2 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.558096 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.583612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.584233 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.584513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.584782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.603030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.669860 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.671746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.682775 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d9b4-18c1-4be8-b93b-83968c3ad82d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.701345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:43.722110 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.722853 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.723144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.723421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.724161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] RBAC: Adding query filter params (group.id=4e02d456d7214409b96be7bc087179f2, role.id=a3fc537dd6f9468895373cc15d975f81, scope.project.id=8a4a7ab85b304b78980350e83a4223b1) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:43.724476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.725954 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.733387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 168/332] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/role_assignments?group.id=4e02d456d7214409b96be7bc087179f2&scope.project.id=8a4a7ab85b304b78980350e83a4223b1&role.id=a3fc537dd6f9468895373cc15d975f81 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:43.791433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 165/333] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:43.797535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.905400 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5010a3-f725-458a-a198-a412b59d4864 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:43.938555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:43.939090 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:43.939368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:43.939636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] PATH_INFO: `/v3/projects/943bb932238542588166ff5bb66e3c95` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:43.940754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] RBAC: Authorizing `identity:get_project(project_id=943bb932238542588166ff5bb66e3c95)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:43.942218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:43.943835 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 169/334] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/projects/943bb932238542588166ff5bb66e3c95 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:43.949532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:43.996996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:44.050078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb780e-3e6e-4608-b58f-c1b1975a0ce4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:44.084369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:44.085003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:44.085337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:44.085610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] PATH_INFO: `/v3/groups/e54042084042470889f699e490acc01b` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:44.086695 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] RBAC: Authorizing `identity:get_group(group_id=e54042084042470889f699e490acc01b)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:44.088127 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5985-ffa5-451b-86c4-6314efc8ff13 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:44.089722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 166/335] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Oct 13 04:08:43 2022] GET /identity/v3/groups/e54042084042470889f699e490acc01b => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:44.096139 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:44.145501 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:44.194717 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6c98d-1bf6-4e3d-b92a-c6fd6e4410a2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:44.227139 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:44.227741 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:44.228023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:44.228298 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:44.229307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] RBAC: Adding query filter params (group.id=e54042084042470889f699e490acc01b, role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=943bb932238542588166ff5bb66e3c95) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:44.229623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:44.231056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043a8a6-f2b6-46cf-913c-bce22b927eaf None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:44.237093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 170/336] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Oct 13 04:08:44 2022] GET /identity/v3/role_assignments?group.id=e54042084042470889f699e490acc01b&scope.project.id=943bb932238542588166ff5bb66e3c95&role.id=b14e21de15a34f23963248e91563ee32 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:46.881613 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5ff-6cb8-41bd-8dcb-65363508dde7 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:46.882133 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5ff-6cb8-41bd-8dcb-65363508dde7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:46.882207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5ff-6cb8-41bd-8dcb-65363508dde7 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:46.883751 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 167/337] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:46.889888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9eef4-062d-42d1-ab48-9e57db8b07c5 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:46.890369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9eef4-062d-42d1-ab48-9e57db8b07c5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:46.890446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9eef4-062d-42d1-ab48-9e57db8b07c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:46.910740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477497-8b29-4495-8059-b73efb90954d None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:46.910924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f3a9eef4-062d-42d1-ab48-9e57db8b07c5 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:46.911447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477497-8b29-4495-8059-b73efb90954d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:46.911972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32477497-8b29-4495-8059-b73efb90954d None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:46.912075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f3a9eef4-062d-42d1-ab48-9e57db8b07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:46.913710 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 168/338] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:46.920061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8fee-d22d-44dd-8860-5a726b40afbb None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:46.920339 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8fee-d22d-44dd-8860-5a726b40afbb None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:46.920790 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a8fee-d22d-44dd-8860-5a726b40afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:46.947814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-1d7a8fee-d22d-44dd-8860-5a726b40afbb None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:46.948994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-1d7a8fee-d22d-44dd-8860-5a726b40afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:47.013196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 171/339] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:47.063223 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 169/340] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:47.239159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eb9-894a-426e-a35e-dde85759a0fb None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.239835 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eb9-894a-426e-a35e-dde85759a0fb None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.240342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eb9-894a-426e-a35e-dde85759a0fb None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.242160 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 172/341] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:47.247591 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.248103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.248612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.267089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:47.268527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:47.308713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:47.358991 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 170/342] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:47.366690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866eb9-894a-426e-a35e-dde85759a0fb None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.420830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:47.458457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.495036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866eb9-894a-426e-a35e-dde85759a0fb None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:47.561956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:47.562639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.562926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.563192 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.582200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:47.584298 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:47.610349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:47.611329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:47.612168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:47.612168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.612168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:47.614177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 173/343] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:47.619822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.647528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52323ee3-067e-4fea-a92e-c498f5b98374 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:47.700829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:47.701881 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.702157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.702426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.716131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:47.717872 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:47.736650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:47.737577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:47.738436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:47.738436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.738436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:47.738436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 171/344] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:47.740067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.754704 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:47.763069 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5da05-92ed-4a30-9353-63a97cc202f7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:47.780065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:47.803511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:47.804274 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.804639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.804988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.805734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:47.806038 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:47.807416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:47.832555 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 174/345] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:47.833502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.875035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803412-5237-4434-9060-f63e2c13c0f8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:47.924081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:47.924969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:47.925762 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:47.926849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:47.942424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:47.943906 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:47.949563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9fd0e-b972-4fed-89be-584f3f28df38 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:47.959856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:47.960759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:47.961663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:47.961663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:47.961663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:47.961663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 172/346] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:47.961663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:47.999806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:48.000910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.001285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.001564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.002330 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:48.002643 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:48.004523 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:48.018579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 175/347] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:48.019583 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:48.039121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:48.049554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:48.074166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985179-7806-46f0-804e-01bc952dc557 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:48.115472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:48.116520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.116800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.117077 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.117756 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:48.119222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:48.137442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9fdd-260d-49db-9e90-c6f80a388d4c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:48.140878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 173/348] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:47 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:48.141840 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:48.186955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:48.187911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.188425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.188930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.189878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:48.190389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:48.192103 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5c10-78c2-43c6-aad3-a9acc7f26c56 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:48.206084 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 176/349] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:48.207666 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc0380-c8b2-40eb-8cfc-3d8132c301a7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.208124 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc0380-c8b2-40eb-8cfc-3d8132c301a7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.208584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc0380-c8b2-40eb-8cfc-3d8132c301a7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.210126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 177/350] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:48.216518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc0380-c8b2-40eb-8cfc-3d8132c301a7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:48.275439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ec3c8-6205-4ee5-9a64-a6e3f76404c8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:48.305829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:48.341263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:48.341913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.342217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.343046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.343760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:48.345685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e18db0-0c3b-443f-b1d8-220620ed23e3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:48.347728 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc0380-c8b2-40eb-8cfc-3d8132c301a7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:48.356191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:48.381184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 174/351] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:48 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:48.381184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.381184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.381184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.402670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:48.402920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:48.403950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.404387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.404660 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.404764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:48.405340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:48.407085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf54f1-7c09-4dac-a361-72b2afbb69a9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:48.435519 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 178/352] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:48 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:48.447017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f41-dcd2-472a-ac3c-d8728f78adee None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.447345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f41-dcd2-472a-ac3c-d8728f78adee None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.447572 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f41-dcd2-472a-ac3c-d8728f78adee None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.449262 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 179/353] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:48.455595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:48.455979 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:48.456361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:48.479472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:48.480706 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:48.499700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 175/354] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:48.563697 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 180/355] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:48.804520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:48.854774 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:48.946922 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:48.973308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b8c19-345c-4a16-8f51-af15dd3a9890 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.010128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:49.022928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b1d5-13a1-4b20-8bb0-504472b3bdaa None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.034998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.035647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.035924 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.036196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.053187 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:49.054675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:49.077965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:49.078971 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:49.079916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:49.079916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:49.079916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:49.080083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 176/356] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:49.091387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:49.105515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.106061 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.106418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.106695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.107370 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:49.108746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:49.124590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.sql.core [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 04:08:49.124590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 04:08:49.124590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [parameters: {'id': '80219090b92a4f37b6af47a77f7cbd9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 04:08:49.124590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result.read() Oct 13 04:08:49.156421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return ref.to_dict() Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:08:49.157387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application yield resource Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise self.value Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application session.commit() Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 04:08:49.158294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.session.flush() Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application compat.raise_( Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 04:08:49.159191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:08:49.160031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result.read() Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:08:49.160813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [parameters: {'id': '80219090b92a4f37b6af47a77f7cbd9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:49.163601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 04:08:49.165552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.167763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 181/357] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Oct 13 04:08:48 2022] POST /identity/v3/roles => generated 144 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:49.170633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:49.276295 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc4f4e-dbb8-46d3-91b5-29c2bc5e5aba None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.301674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976fe09-ca47-4cd4-870c-5ac9025309e3 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.328506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:49.339795 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.340511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.340913 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.341296 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.353692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:49.357889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.358454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.358732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.359006 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:49.359475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:49.360517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 04:08:49.361543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:49.362723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:49.362723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:49.362723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:49.362908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 182/358] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:08:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:49.370479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:49.379292 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 177/359] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:49.386097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:49.428714 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:49.509112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef271-fc43-4009-9336-2fa1ef46ba85 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.554508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.555481 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.556098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.556475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.557907 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:49.559475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bb467-edff-4f5d-af1a-59ffeb67a25f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:49.559606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e818a5-7be4-44eb-8f8c-f0c264233a0f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:49.595287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 178/360] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:49 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:49.629494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:49.630135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:49.630414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:49.630735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:49.631423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:49.631796 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:49.633340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5dbb2-f3f7-4dc9-ab40-86d656782d83 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:49.649268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 183/361] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:50.646699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169710b-6ddb-4f48-b98e-1a31a566d7d7 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:50.647201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169710b-6ddb-4f48-b98e-1a31a566d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:50.647201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169710b-6ddb-4f48-b98e-1a31a566d7d7 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:50.648738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 179/362] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:50.654445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5547-4cf3-4f73-b9e0-14c1bc66b5f4 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:50.654921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5547-4cf3-4f73-b9e0-14c1bc66b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:50.654996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda5547-4cf3-4f73-b9e0-14c1bc66b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:50.678034 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-acda5547-4cf3-4f73-b9e0-14c1bc66b5f4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:50.679216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-acda5547-4cf3-4f73-b9e0-14c1bc66b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:50.736000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:50.779777 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 184/363] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:51.130969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169710b-6ddb-4f48-b98e-1a31a566d7d7 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.214068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e3fc-5915-4b1b-8f92-bc1ddccd0123 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.214416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e3fc-5915-4b1b-8f92-bc1ddccd0123 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.214611 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e3fc-5915-4b1b-8f92-bc1ddccd0123 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.216534 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 185/364] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:08:51.222876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959700b-1715-4885-8c1a-c0d7c8e9af1a None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.223214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959700b-1715-4885-8c1a-c0d7c8e9af1a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.223477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959700b-1715-4885-8c1a-c0d7c8e9af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.255527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-1959700b-1715-4885-8c1a-c0d7c8e9af1a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:51.256692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1959700b-1715-4885-8c1a-c0d7c8e9af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:51.274892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:51.295164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169710b-6ddb-4f48-b98e-1a31a566d7d7 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:51.348801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:51.349792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.350314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.350791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.365206 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 186/365] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:51.366757 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e48d-7b91-499e-bb60-34333eddce12 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.367237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e48d-7b91-499e-bb60-34333eddce12 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.367720 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e48d-7b91-499e-bb60-34333eddce12 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.369226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 187/366] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:51.370459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:51.376190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:51.377044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:51.377857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:51.380491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 180/367] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:51.382630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.383114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.383587 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.387293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.415371 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:51.416628 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:51.547640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 188/368] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:08:51.555822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff36c-7d53-4506-80ec-8180ef5b18b9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:51.590557 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:51.591198 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.591478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.591749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.592416 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:51.592717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:51.594146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:51.602552 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 181/369] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:51.608833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.644182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:51.710817 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad9ec0-9180-4e73-ba33-11e04fe28cd2 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:51.749821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:51.750469 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.750575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.750976 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.750976 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.761730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:51.766714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:51.768665 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:51.797920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:51.798876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:51.799717 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:51.799717 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:51.799717 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:51.805743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 189/370] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:51.815357 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.895797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c956b-42e6-4bea-88b1-52eec39b1cfd None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:51.931687 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:51.932532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.932900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.933317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.941612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:51.944942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:51.946010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ec84-e96a-46f6-9c27-f542ac9ad128 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:51.950730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:51.951747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:51.952550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:51.957813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 182/371] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:51.957813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:51.992521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:51.993446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:51.993870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:51.994303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:51.995085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:51.995529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:51.997709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.011603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 190/372] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:52.012759 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.032833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.072216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85ef1-ec72-4cb9-92bf-9fdceb3c0f86 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.110265 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.111044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.111425 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.111799 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.123985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:52.129656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:52.130729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:52.131535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:52.132332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 183/373] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:52.133383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.141058 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5da7e-308c-4d4d-8d92-aa851100254f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.185298 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.186188 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.186476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.186751 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.187419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:52.187725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.189084 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.198165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 191/374] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:52.198793 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.212185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.246711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883183af-6a64-4e49-9088-5f5f0a65795e None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.275877 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.282684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.283317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.283715 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.284002 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.291792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.293282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-2f452ce0-d89a-4b5c-8cf4-c7e294a50d23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:52.306120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:52.307025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:08:52.313103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:52.313700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3823544-1d67-4c4e-81a5-f2570f6d4ff0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 184/375] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3eea-55b6-490d-9cc0-6814b1922fac None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3eea-55b6-490d-9cc0-6814b1922fac None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3eea-55b6-490d-9cc0-6814b1922fac None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 185/376] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:52.313771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d3eea-55b6-490d-9cc0-6814b1922fac None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.349779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.350418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.350705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.350975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.351633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:52.351932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.353331 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.362157 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 192/377] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:52.362946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.436240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d3eea-55b6-490d-9cc0-6814b1922fac None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.440109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.472434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.473068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.473340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3558ec-0ede-4dc3-a6ef-c23b87796aed None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.473441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.473647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.486245 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.487720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3676d5e5-ba53-4d2b-8725-a6707e3c7259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:52.502261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:52.503201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:52.504386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:52.504386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.504386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:52.504386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 186/378] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:52.504657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32ae3-3986-48e1-b40c-0d77db3aa3fa None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.504734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32ae3-3986-48e1-b40c-0d77db3aa3fa None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.504985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32ae3-3986-48e1-b40c-0d77db3aa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.513786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.514433 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.514712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.514984 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.515708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:52.516012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.517465 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.523261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-83c32ae3-3986-48e1-b40c-0d77db3aa3fa None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:52.524437 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-83c32ae3-3986-48e1-b40c-0d77db3aa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:52.554031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 193/379] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:52.554862 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.559736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.590323 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 187/380] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:52.592212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681061-a79c-44f0-9a40-3dd3bf77edba None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.592496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681061-a79c-44f0-9a40-3dd3bf77edba None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.592766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681061-a79c-44f0-9a40-3dd3bf77edba None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.594030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 188/381] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:52.594709 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5681061-a79c-44f0-9a40-3dd3bf77edba None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.660473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a51c34-44f9-47fc-b1d0-f4daf740c19d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.691928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.695961 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5681061-a79c-44f0-9a40-3dd3bf77edba None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.698351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.698973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.699254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.699521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.710199 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.711662 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:52.728799 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:52.729725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:52.730558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:52.730558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.730558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:52.730558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 194/382] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:52.730767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.740272 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.740421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.740615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.740892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.741569 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:52.741875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.743250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0998-2d27-400d-b385-1cc4a5a1f078 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.754702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 189/383] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:52.759580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.759580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.759580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.774726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:52.775903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:52.802204 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.846680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 190/384] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:52.847416 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.859866 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9e48-0af3-4c81-87ac-85539018ec13 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.894647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.895276 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.895547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.895815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.907015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.908466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:52.922140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:52.923047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:52.923889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:52.923889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:52.923889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:52.923889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 195/385] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:52.924523 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:52.952181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2110a9-16df-4fc7-bb7f-198e62738192 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:52.958886 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:52.990744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:52.991357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:52.991640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:52.991960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:52.992558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:52.992864 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:52.994287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.006056 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 191/386] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.006869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.034477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea03b-34f4-4b56-98b5-db46d71e6517 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.035084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.069326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.069951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.070228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.070495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] PATH_INFO: `/v3/users/glance` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.078615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.080040 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:53.094594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.095484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:53.096390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 196/387] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.100901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.116940 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734747-5795-4c44-a841-f792c8567ee4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.151018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.151674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.151955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.152230 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.162972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:53.168831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.169730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 192/388] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.171156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.192354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.199126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb6504-78e5-4b97-8727-d4f3cdc2dfef None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.232515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.233051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.233356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.233627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.234262 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:53.234564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.235936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.247193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 197/389] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.247988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.250063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.269001 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b3367-4df0-4729-94b4-0b1496064cf7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.301403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.302020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.302303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.302573 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.310248 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.311696 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:53.325251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.326375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 193/390] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.327493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.352696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb71b-7abc-4f1c-aa60-3a18ca2bbff8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.387235 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.387868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.388146 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.388418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.389169 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:53.389471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.390911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.407971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 198/391] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.408984 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.422765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.429542 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eb969-28ae-4836-b408-5ce962e05e8f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.462002 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.462622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.462900 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.463169 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.473727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.475160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.476803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:53.490388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.491270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:53.492089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:53.492089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.492089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.492089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 194/392] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.492314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.510883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67f3a-853b-4d15-acc0-e27d9eabd3cc None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.544300 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.544910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.545217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.545503 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.546165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:53.546471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.547832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.555533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 199/393] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.556315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.590969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d5a6-2c57-464e-9592-31d8d572f98a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.623737 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.624359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.624637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.624928 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.629265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.631427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.632836 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:08:53.644541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.645585 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.646611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 195/394] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.648537 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.656661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ef4a-0440-4864-b6af-c3535996542a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.689968 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.690576 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.690851 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.691832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:53.692129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.693573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.702702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.711866 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 200/395] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.714500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.747812 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a6634-d663-4cac-853a-aeda98498ad0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.781034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.781753 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.782094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.782264 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.794266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.795711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:53.809107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.810085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:53.811345 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:53.811345 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.811345 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.811345 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 196/396] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.811588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efdad-2cf3-43f6-b4d6-b94a7c2d2347 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.811660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.841175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.846422 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.847035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.847320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.847599 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.848242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:53.848546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.849945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.861917 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 201/397] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:53.862710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.910634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb091a6b-8ba8-4385-8d69-0d9ee38c1651 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.917718 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:53.944397 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.945024 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.945332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.945607 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.956017 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:53.957484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:53.960369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b820-926a-4f25-b09f-6d8c7c8edac4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:53.971920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:53.972807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:53.973697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:53.973697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:53.973697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:53.973697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 197/398] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:53.973907 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:53.998154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:53.998695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:53.998974 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:53.999247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:53.999932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:54.000237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.001703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.019387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 202/399] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:54.020182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.069494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29ba6-6178-448b-ab5f-dc4aea8bb8ce None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.077159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.102606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.103240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.103791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.104064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.114880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.116317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.126085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32a67-aa5e-4a78-8c5c-2db42ece8d98 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:54.130000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:54.130952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:54.131820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:54.131820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:54.131820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:54.131820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 198/400] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:54.131820 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.147395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.161312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.161924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.162211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.162482 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.163118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:54.163423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.164795 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.176251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 203/401] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:54.177416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.239170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3efab-1811-4c5c-8ea2-8b86e21a352d None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.272323 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.272864 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.273167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.273446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.274388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.275553 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cacb07-2977-4395-9e68-ea3d5eebb1a2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.275833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.288517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.297075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 199/402] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:08:54 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:08:54.297934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.311637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.312279 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.312595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.312868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.313586 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:54.313902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.315337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.333311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 204/403] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:54.334905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.381429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.423280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357a55e-c61b-444b-975c-7ce2af7781a8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.452380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13108-6ce3-4304-b891-b0ef4f7e5945 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.460770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.461476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.461783 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.462081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.479392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=a583664454f04a79a0f43a418a9f1778, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.480845 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.494727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 200/404] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:54 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:54.495584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.496258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.496412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.497247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.497788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.498199 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:54.498509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.499916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.517881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 205/405] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:54.517881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.555110 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.643738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a431d-ea9a-4d47-a893-dc9e9cc7908c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.655434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ecfe-f628-4655-9824-ba1fd4b8b54d None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.678946 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.690220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.690858 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.691303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.691579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.700478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.700620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.701111 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.701479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.701752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.702101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.709914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.711452 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:54.713943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:54.715114 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:54.716105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 206/406] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:54.716720 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:08:54.731732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:54.732631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:54.733879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:54.736892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 201/407] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:54.736892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.817486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:54.827269 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c15e-881d-4410-b80a-7d729490707b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.864553 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.865515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.865870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.866508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.870046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fc83-d85f-47c5-b9c7-ac7f315026f5 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:54.877462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.879753 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:08:54.896797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:54.897740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 207/408] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:54.899240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:54.914941 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:54.916020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:54.916450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:54.916934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:54.918599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:54.919637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:54.921957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:54.972499 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 202/409] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:54.974051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.010801 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a53807-b0e7-44dd-a13f-b9c775241c0f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.026072 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.048130 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.048740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.049042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.049614 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.050745 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:55.051049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.052494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.073573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 208/410] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:55.074619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.093522 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.110299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211051d5-23d7-42f4-8609-738a196778e9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.147475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.148356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.148863 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.149304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.150226 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:55.150670 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.152355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.174526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 203/411] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:55.175501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.198764 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5213-fd52-4d2c-8336-6b87363fc200 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.239130 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.239985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.240103 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.240380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.252891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.254381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:55.272687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:55.273832 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:55.274822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:55.274822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:55.274822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:55.274822 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 209/412] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:55.279159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.288596 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.298321 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcb92f-a7e7-44a5-8f99-79570aeded13 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.339723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.340437 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.341084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.341418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/c9f37ca9c5dd4d3f8a2aca825139d798/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.360442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=c9f37ca9c5dd4d3f8a2aca825139d798, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.362953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.364676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.385239 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 204/413] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:55 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/c9f37ca9c5dd4d3f8a2aca825139d798/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:55.386598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.467544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82934592-5fc2-494b-85f4-400a60327a2f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.525575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76d908-bba7-4216-bee9-c216968aedf9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.559500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.560204 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.560475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.560754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2e3c18f22aba448e8e26bec28cc24d26/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.565575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.566447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.566901 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.567484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.568317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:55.568791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.570374 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.584744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 205/414] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:55.591175 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.595044 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=2e3c18f22aba448e8e26bec28cc24d26, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.596178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.598074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.620251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 210/415] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:55 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2e3c18f22aba448e8e26bec28cc24d26/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:55.710739 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58e1d-0368-42b0-baf5-73251c892e4d None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.750113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.751166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.751693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.752159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.759843 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.761714 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:08:55.775725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:55.776627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:55.777505 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:55.780014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 206/416] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:55.785483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:55.923613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4a58-ff14-46d5-8e25-4e5233872195 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:55.938902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:55.960002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:55.960616 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:55.960915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:55.961193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:55.961894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:55.962200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:55.963657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e176ee5-9c02-48ea-92a9-fd7732b0ebfa None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:55.977349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 211/417] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:55.983120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:56.071649 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:56.128961 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce335e-5e64-4b1d-8256-a253a37267a4 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:56.174667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:56.175706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:56.176099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:56.176383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/32d83c87e17740eb943517d7f5503817/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:56.202152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=32d83c87e17740eb943517d7f5503817, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:56.203644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387929f-8f6f-4399-8cd2-24e58294c9ff None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:56.222973 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 207/418] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:55 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/32d83c87e17740eb943517d7f5503817/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:56.631838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5535a3-7dc5-4ca7-88d5-d526b3c1519b None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:56.632513 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5535a3-7dc5-4ca7-88d5-d526b3c1519b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:56.632997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5535a3-7dc5-4ca7-88d5-d526b3c1519b None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:56.634796 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 212/419] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:56.640539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f8ea5-8ab5-419c-a034-a60d91be315f None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:56.640829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f8ea5-8ab5-419c-a034-a60d91be315f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:56.641117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f8ea5-8ab5-419c-a034-a60d91be315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:56.670969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-114f8ea5-8ab5-419c-a034-a60d91be315f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:56.672308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-114f8ea5-8ab5-419c-a034-a60d91be315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:56.780049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 208/420] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:56.882935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0321a-ba34-4004-b831-ec827fc8e6f9 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:56.883536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0321a-ba34-4004-b831-ec827fc8e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:56.883536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0321a-ba34-4004-b831-ec827fc8e6f9 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:56.884977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 213/421] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:56.890142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:56.890430 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:56.890708 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:56.914105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:56.915282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:56.981575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:57.017223 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 209/422] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:57.181406 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0321a-ba34-4004-b831-ec827fc8e6f9 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.296519 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0321a-ba34-4004-b831-ec827fc8e6f9 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.339214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:57.339869 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:57.340152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:57.340952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:57.355910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:57.365951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:57.366849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:57.367655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:57.368244 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.368323 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 214/423] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:57.375025 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.410021 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:57.479725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff352b2-5459-4d8f-84a2-62cee50ac3a4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.517073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:57.518134 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:57.518637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:57.519109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:57.520045 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:57.520697 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:57.522377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:57.532321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 215/424] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:57.538178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.579352 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b8918-eeec-4109-a8c8-72e8c6e4654a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.645483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:57.650380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511fb2-a2ff-4eef-8795-3f2e9038b840 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.654879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:57.655520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:57.655796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:57.656065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:57.672721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:57.678300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:57.679155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:57.679965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 210/425] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:57.692808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.708859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:57.709863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:57.710288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:57.710732 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:57.722453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:57.724126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:57.740112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:57.741018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:57.741890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:57.741890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:57.741890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:57.744113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 216/426] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:57.749837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.763409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:57.856978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b41ce-ca8f-42ce-9b44-97cbe32548a8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.892574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:57.893943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:57.894406 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:57.894885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:57.895707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:57.896183 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:57.897774 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:57.899072 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d220d-345f-41cb-85ab-7d90ed02f1b7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:57.911939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 217/427] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:57.917607 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:57.929328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.017951 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.018543 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.018772 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.019043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.019716 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:58.020116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.021421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.027266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bb695-3a1d-42a1-ad16-33cd4633c6d2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.051410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 211/428] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:58.066777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.069338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.070168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.070646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.071093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.085677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.087349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:58.116478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:58.117466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:08:58.118343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:58.121554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 218/429] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:08:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:08:58.137746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.252627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.261387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075253b-1580-4437-8414-fc47cdf902e9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.274444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.304129 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.305611 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.306039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.306455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.316579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d478d5-67d7-4b1f-8b6b-b6c0998031d7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.323068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.325835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-20116a93-23ec-477a-b7cb-66868f4a2ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:58.347273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:58.348388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:58.349261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:58.349261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:58.349261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:58.349261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 212/430] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:58.354768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415fab8-0174-4ec5-b320-f787c1a7ad43 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.355062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415fab8-0174-4ec5-b320-f787c1a7ad43 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.355311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415fab8-0174-4ec5-b320-f787c1a7ad43 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.357386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 213/431] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:58.358751 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415fab8-0174-4ec5-b320-f787c1a7ad43 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.375872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.376541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.376820 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.377090 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.378263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:58.378577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.380372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23800170-70d1-4dc1-9ee5-b30a7db835e9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.403039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 219/432] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:08:58.404390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.404678 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.405057 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.429395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:58.431010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:58.485453 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415fab8-0174-4ec5-b320-f787c1a7ad43 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.502912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 220/433] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:58.503961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.536802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.537460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.537809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.538147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.538878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:58.539238 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.541779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121c3cb-2fc0-482e-ab89-d35752b004b7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.564423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 214/434] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:58.564423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7756d-6c90-4090-ae39-a82be581bb6c None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.564423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7756d-6c90-4090-ae39-a82be581bb6c None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.564423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7756d-6c90-4090-ae39-a82be581bb6c None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.564423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 215/435] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:58.566190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7756d-6c90-4090-ae39-a82be581bb6c None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.572052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.585491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.626420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2fa0-cf05-4aac-924a-d5d63a52cf2e None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.666601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.667328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.667686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.668051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.680111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.682027 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-9f6fb423-e7b4-4b8f-aa02-97b7172c97f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:58.699426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:58.700397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:58.701293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:58.701293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:58.701293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:58.701293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 221/436] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:58.702386 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.703254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.703651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.707079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7756d-6c90-4090-ae39-a82be581bb6c None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.723554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:58.725048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:58.751843 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.753048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.753521 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.754469 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.765875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.767929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:08:58.786333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:58.787351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:08:58.788261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 216/437] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:58.788809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.815557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 222/438] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:58.818017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.870846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.877057 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:58.912923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a6fc-8791-4a6d-964d-ef683c2b395a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.942195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bad9-441a-4350-9f8c-b689c5aaac42 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:58.949968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.950654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.950934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.951206 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.951913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:58.952217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:58.953690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:58.966166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 217/439] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:58.966851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:58.982501 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:58.983129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:58.983404 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:58.983674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:58.997179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-667328c5-2472-46a1-a086-7b32035ec8fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:59.001879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:59.002950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:59.003856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 223/440] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:59.004548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f99a1-346f-4962-a4b6-40886bde3fa5 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.004612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f99a1-346f-4962-a4b6-40886bde3fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.004874 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f99a1-346f-4962-a4b6-40886bde3fa5 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.006314 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 224/441] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:08:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:08:59.010875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f99a1-346f-4962-a4b6-40886bde3fa5 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.079220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee943e-6493-410b-a13f-d9027a65cca2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.108546 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.110299 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.115315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f99a1-346f-4962-a4b6-40886bde3fa5 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.116609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.117404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.118439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.118719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.119441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:59.119746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.121196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.139540 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 218/442] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:08:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:59.140340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.149208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.149833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.150107 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.150371 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.157311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.158731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-b7424a46-3b0b-46c8-bed2-5dd314bec019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:08:59.170517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:59.171443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:59.172272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 225/443] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:59.172784 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.173067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.173372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.190503 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:08:59.191695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:08:59.242422 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d06eba-4f91-4007-95de-7e1f84af6ab3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.258111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 226/444] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:08:59.258922 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.288275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.288882 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.289183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.289457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.290116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:59.290422 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.291789 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.300354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 219/445] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:59.301155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.357968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.362997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.376460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca026f8c-951f-4a24-b404-2d1b7fef64a8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.411277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.411901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.412176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.412441 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.422621 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9dc93-86a3-447a-9c7a-b8cae42e0792 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.423329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:59.428168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:59.429263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:59.430238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 227/446] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:59.430925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.461311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.461916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.462198 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.462473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.528639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.530115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.541442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb269a3-b760-4986-af3a-5a4eeb85074c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.575304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.575509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.576105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.576410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.576655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.577362 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:59.577662 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.579079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.590980 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 228/447] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:59.591698 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.604181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.633286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 220/448] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:08:59.634134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.692952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d48e6-f6b1-46d0-b0e8-20ba1a637a7e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.725487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.726111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.726393 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.726669 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.730905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94798205-f0b5-4358-ad34-469af9ea63d9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.737489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.738935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:08:59.753624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:59.754559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:08:59.755387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:08:59.755387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:08:59.755387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:59.755387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 229/449] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:59.755612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.767405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.768014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.768294 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.768564 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.769255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:08:59.769561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.770929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.778932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 221/450] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:08:59.778932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.795752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.814379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:08:59.855365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524cbeb-43b2-4076-9b53-6a9b0a345aac None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.881043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f255-3866-4652-bcb7-a5c66caf261a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:08:59.888632 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.889284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.889563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.889834 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.899607 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:08:59.904821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:08:59.905731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:08:59.906527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:08:59.910775 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 230/451] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:08:59.911472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:08:59.915696 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:08:59.916353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:08:59.916635 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:08:59.916919 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/15838b36537140b7a402b54722e4594e/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:08:59.932762 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=15838b36537140b7a402b54722e4594e, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:08:59.934357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:08:59.948149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 222/452] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:08:59 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/15838b36537140b7a402b54722e4594e/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:08:59.948932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.015614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.027756 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b998e4-1b40-4a6a-b903-77b7830b35e9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.051044 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.062932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59b7c-2e45-4d19-ae29-803e18901ac1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.068356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.068999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.069316 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.069648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.082805 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.084347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.100872 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.101645 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.101856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.102151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:00.102588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:00.103431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:00.109943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:00.109943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.109943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:00.110189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.110189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.110349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 231/453] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:00.110429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.110503 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.123516 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 223/454] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.123703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.222109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c642ffc-844f-4e0b-ae48-036674cbc386 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.229393 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94df04-bf74-4353-abaf-e1a40e5c750b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.251586 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.265982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.266743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.267092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.267433 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.267688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.268373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.268731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.269085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.269854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.270231 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.271684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.280272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.285334 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 224/455] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.285334 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.285536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:00.299675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:00.300766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:00.301837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:00.301837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.301837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:00.306829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 232/456] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:00.306829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.343303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.394351 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b4308-e8d2-41f8-8681-5952d6eea890 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.422721 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b04d-ae4f-4406-94ef-eacc2248bca2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.436602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.437832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.438299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.438647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.439526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.439903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.441674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.457241 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.458118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.458441 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.458710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.461263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 225/457] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.462511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.467582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.469014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:00.481602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:00.482496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:09:00.483396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:00.485432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 233/458] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:00.486340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.510054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.567806 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba56e6-f602-4090-8686-c77fb3c4dfa2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.585192 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.603715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa522d-59e6-4ad7-97dd-5132809ca8ab None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.610239 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.610869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.611407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.611407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.621545 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.623043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:00.638005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:00.638922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:00.639770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:00.639770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:00.639770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:00.639770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 226/459] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:00.640461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.646113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.646668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.646944 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.647212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.647857 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.648158 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.649562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.666307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 234/460] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.666307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.742043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.750494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d883c-d8df-4450-86bc-e8eed90470e8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.771524 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c24e-1f88-48d5-ac26-7c611f64b1cc None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.783372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.783986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.784280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.784551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.791086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.792517 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:00.804424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:00.805633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:00.806468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:00.808645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.809868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.810147 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.810454 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.811212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.811511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.812689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 227/461] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:00.813177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.813396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.833394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 235/462] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.834260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.837016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.918675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb818-e543-4562-aff7-368c70d96c8a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.938281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc62-95ff-4837-bbb9-9c3367dd6aae None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:00.955376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.956067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.956349 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.956619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.957287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:00.957590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.958956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:00.971608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 228/463] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:00.972457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:00.980569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:00.981715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:00.981996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:00.982271 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:00.988652 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:00.990668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:00.992510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:01.005497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:01.006384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:01.007257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 236/464] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:01.007829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.075993 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.091312 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93d5c-b9e2-456f-8cf5-3300484572e8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.117008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9e88-c5d1-427f-b62a-f246b07df6b0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.128058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.128879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.129267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.129627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.130385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:01.130756 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.132276 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.145954 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 229/465] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:01.146813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.156951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.157950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.158289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.158569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.228338 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.232819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.234403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.257088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03e4b-bd60-4262-afd4-6c9d06d4db0c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.290133 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.290917 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.291296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.291577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.298184 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.299352 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.300802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:01.312340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:01.313314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:01.314249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 230/466] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:01.314800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.348575 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 237/467] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:09:01.348575 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.434931 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a029-eb1c-4171-98f7-c29056e4f8dd None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.454371 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5245-55ea-4744-a145-59cb819acf2e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.469342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.470064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.470440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.470811 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.471638 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:01.472039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.473613 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.475305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.490817 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.491349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.491636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.491906 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.492623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=a583664454f04a79a0f43a418a9f1778) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:01.492930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.498643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 231/468] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:01.498772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.498858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.513198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 238/469] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/role_assignments?user.id=a583664454f04a79a0f43a418a9f1778&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:01.513198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.543794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.622366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f08e-d4c5-4458-860f-28be0b4a1ebe None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.641261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b229-1018-4e81-a83f-de853a94cbcc None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.676869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.677558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.677913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.678257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.679076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:01.679501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.680182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.680900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.681160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.681350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.681688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.698637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.699370 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.708009 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 232/470] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:01.709043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:01.722690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:01.723798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:01.724828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:01.724828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:01.724828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:01.724828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 239/471] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:01.725096 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:01.782729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.820562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:01.828224 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc59e5-4d0f-48a2-a29f-7981a5c40395 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.848343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebfe45-db98-4818-8770-c977620e76d9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:01.864141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.865068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.865570 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.866033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.887755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:01.888336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:01.888607 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:01.888875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:01.942858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.944342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.974039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:01.976705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:01.994887 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.057221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 233/472] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:09:02.058050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.077767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.108584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 240/473] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:09:02.114754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.167673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d083c1f-3f0c-4f65-9762-4b132980ecac None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.204102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.204702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.204978 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.205354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.206100 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:02.206412 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.207792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.217617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad2cb-ca90-47d2-9609-8462e8e9e384 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.223962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 234/474] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:02.224594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.238790 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.254261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.255004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.255282 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.255557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.266736 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.268167 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d61497df-3560-4308-9f80-b46805e465cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:02.283894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:02.284808 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:02.285722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:02.285722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:02.285722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:02.285722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 241/475] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:02.286502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c815-8ead-422a-b330-dce3d13fe52f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.286613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c815-8ead-422a-b330-dce3d13fe52f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.286803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c815-8ead-422a-b330-dce3d13fe52f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.292291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 242/476] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:02.292291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c815-8ead-422a-b330-dce3d13fe52f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.331092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.339384 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389b2f0-e2de-4c34-8e41-d0a1a92c523a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.376327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.376647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.376922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.377216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.387813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.389274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:02.404080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:02.405178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:02.406240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:02.406240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:02.406240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:02.406777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 235/477] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:02.407547 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.415143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c815-8ead-422a-b330-dce3d13fe52f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.450959 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.451701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.451982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.452254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.460418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.462245 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.474479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-fd47574a-06cb-4b7e-a78c-75f226ee10c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:02.477303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:02.478315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:02.479617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 243/478] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:02.480185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.480185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.485727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.499480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:02.500734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:02.523791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77335458-1d69-40e9-80f6-6e65e1609038 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.559626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.560347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.560622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.560894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.561558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:02.561856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.563437 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.570960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 244/479] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:02.571860 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.591439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 236/480] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:02.591439 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.603714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.697161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a654-ff62-43ab-b607-6dde5a09e0c0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.709715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041400e0-9cd1-4bcc-83b5-8c7f01d991e0 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.721138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.735163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.735909 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.736293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.736685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.737619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:02.737933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.739477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.756667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 237/481] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:02.756667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.759375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.760195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.760593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.760993 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.761961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:02.762828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.764505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.781630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 245/482] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:02.782677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.876735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:02.877250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99147d-9bba-45f1-a99b-3f066386010a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.901120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd02c54-bb36-4f72-86cb-43a6b2795ab6 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:02.911381 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.912016 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.912297 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.912571 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.919934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.921428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:02.933689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:02.934784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 238/483] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:02.935691 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.946381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:02.947175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:02.947593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:02.948431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:02.949368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=2e3c18f22aba448e8e26bec28cc24d26) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:02.950723 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:02.952866 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:02.959446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 246/484] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/role_assignments?user.id=2e3c18f22aba448e8e26bec28cc24d26&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:02.960366 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:02.986626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.057514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca696a0-07f7-4d8e-a95c-7615114d47f0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.095012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.095834 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.096180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.096532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.104663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.107015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.114695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d064c-205b-4456-8ddb-ffac5e4b3e7c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:03.119923 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:03.120985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:03.122728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:03.127414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 239/485] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:03.128297 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.162311 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.163128 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.163498 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.163780 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.177546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:03.183308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:03.184740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:03.185588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 247/486] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:03.186239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.194309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.266816 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3481-3080-41e9-8895-fc94b6d78785 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.269177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.298254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdf9c-b432-4851-9a6f-cd028a657317 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.315265 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.316000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.317504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.317996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.318960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.320756 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.323169 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.342207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 240/487] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.343140 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.357154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.357154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.357154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.357154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.357540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.357540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.357540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.372305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 248/488] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.373263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.453753 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.460529 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ee20c-65e9-45b1-b78a-0e4b6326910b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.501505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8a39-9d22-428a-b5e2-94039b59bfaf None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.506070 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.506838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.507257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.507631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.508408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.508810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.510313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.523669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 241/489] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.524688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.541056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b659-8902-477e-8818-07dd85816719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.541902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b659-8902-477e-8818-07dd85816719 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.542395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b659-8902-477e-8818-07dd85816719 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.542848 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b659-8902-477e-8818-07dd85816719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.544395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b659-8902-477e-8818-07dd85816719 None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=c9f37ca9c5dd4d3f8a2aca825139d798) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.544982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b659-8902-477e-8818-07dd85816719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.546691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b659-8902-477e-8818-07dd85816719 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.551599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.554384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 249/490] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/role_assignments?user.id=c9f37ca9c5dd4d3f8a2aca825139d798&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.556095 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b659-8902-477e-8818-07dd85816719 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.635966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab978-34cc-47e7-824c-947eabacc924 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.674654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b659-8902-477e-8818-07dd85816719 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.676078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.676982 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.677173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.677741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.679273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=32d83c87e17740eb943517d7f5503817) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.679273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.680526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810c51c-6407-4694-982a-95f5f4f641f6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.688005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 242/491] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/role_assignments?user.id=32d83c87e17740eb943517d7f5503817&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.721910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:03.736394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.737261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.737582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.737814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.754923 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.756446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.758692 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c22-659c-4cdb-97f2-4836cfbea637 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.759318 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c22-659c-4cdb-97f2-4836cfbea637 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.759839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c22-659c-4cdb-97f2-4836cfbea637 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.761528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 243/492] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:03.767418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.768108 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.768615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:03.776779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:03.777861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:03.779253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:03.779253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:03.779253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:03.779253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 250/493] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:03.783422 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:03.814235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:03.815460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:03.912963 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 244/494] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:09:03.922830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914752-e15a-4837-8551-7f1fd91fa598 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:03.964953 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:03.966118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:03.966401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:03.966672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:03.967313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:03.967612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:03.968979 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:03.982203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 251/495] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:03.987498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.007656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.096175 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef529d2c-e79b-40e1-a1c5-350f1dd90b15 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.147311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:04.147936 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:04.148315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:04.148637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:04.160427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:04.161902 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:04.176199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:04.177142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:04.178717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 245/496] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:04.182894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.226159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.265781 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.371720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.382179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092e2e-596d-49f7-85bf-b7ec40aebcd1 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.412969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecce68-8f80-49e8-bfd3-a8618a169f18 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.448836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:04.450452 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:04.450955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:04.451443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:04.452374 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:04.453082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:04.455404 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:04.471141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:04.472120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:04.472601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:04.473074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:04.494472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 252/497] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:04.495776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:04.501503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:04.502407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:04.503313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:04.505372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.507493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 246/498] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:04.517239 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.640710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.645813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523c982-9f24-4369-978b-13b04a0f55a0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.683346 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:04.684804 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:04.685258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:04.685675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:04.740922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba364a5-b830-41d4-8c2f-928f1c8d0ac5 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.779998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:04.781285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:04.781710 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:04.782148 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:04.782987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:04.783433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:04.785007 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:04.794455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.797099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 247/499] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:04.806464 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:04.826101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:04.827578 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:04.975016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 253/500] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 04:09:04.975565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:04.981157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ff2e-4d28-4bde-9e5e-eddec8aee270 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:04.982325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.078464 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.079182 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.079491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.079835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.084463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd1a2c-815b-460b-a973-3f7f1f6ac4a0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.113939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.115493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.120047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.120977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.121529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.122149 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.133414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.135580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:05.148180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:05.149599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:05.150494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:05.150494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:05.150494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:05.153349 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 248/501] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:05.155407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:05.156293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:05.157200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:05.157200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:05.157200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:05.158067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.159360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 254/502] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:05.165588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.261655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.271244 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.364858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44e6d-3dc6-4830-80c4-8f591453be9e None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.372733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c290b3-97fd-42fd-b275-23497610f7a5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.436398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.438210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.439143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.440048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.441281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:05.441802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.443390 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.446725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.447767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.453283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.453791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.454634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:05.455137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.456692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.467717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 249/503] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:05.475231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 255/504] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:05.481737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.481959 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.646550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1d209-893f-4281-a5e6-cdb9080761d8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.650994 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82cd55-5b5f-49fd-94bb-58c3a90ae548 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.662779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.663136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.688663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.688663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.688663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.689316 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.692562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.693458 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.693889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.694331 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.696992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.698576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.703255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.705033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-47cd7beb-863a-4143-8695-0ca5ec1822f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:05.710712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:05.711771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:05.712688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:05.718151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 250/505] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:05.719451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba77e-8a4b-4293-a7ab-63568c63f8ea None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.719810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba77e-8a4b-4293-a7ab-63568c63f8ea None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.720155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba77e-8a4b-4293-a7ab-63568c63f8ea None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.721748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 251/506] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-5e5bd488-c110-4269-aef8-3b07db5ff91b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:05.722151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:05.723028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:05.723991 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:05.724509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba77e-8a4b-4293-a7ab-63568c63f8ea None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.726381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 256/507] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:05.727774 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.728267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.729015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.749905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:05.751453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:05.839087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba77e-8a4b-4293-a7ab-63568c63f8ea None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:05.844615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 257/508] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:05.845615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.888281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:05.889972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:05.890444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:05.890924 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:05.892296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:05.892793 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:05.895097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:05.912490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 252/509] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:05.922111 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:05.984446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.989305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:05.990174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb4e4e-60da-44dd-82e8-ba5ddea230a8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.058285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.059028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.059305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.059574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.060328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:06.060630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.062162 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.100670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 258/510] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:06.108675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.135098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b201f8-2edb-4e36-9eca-9cba6483f402 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.180194 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.180830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.181106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.181400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.182126 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=15838b36537140b7a402b54722e4594e) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:06.182434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.184413 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.190885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 253/511] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:05 2022] GET /identity/v3/role_assignments?user.id=15838b36537140b7a402b54722e4594e&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:06.191698 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.255950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755946-fe6a-4af6-aeb2-eee1cb120cef None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.298507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.299139 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.305158 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.305158 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.311819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.313527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-4bc46a84-4c5b-4667-bc86-62cf83c98441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:06.335258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:06.336217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:06.337111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:06.337111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:06.337111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:06.340974 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 259/512] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:06.342485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffcad-2d4f-4c0c-983e-cc5df85c9e0c None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.342767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffcad-2d4f-4c0c-983e-cc5df85c9e0c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.343039 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffcad-2d4f-4c0c-983e-cc5df85c9e0c None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.344403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 260/513] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:06.345551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d4b2-19cd-48da-8fb6-015ad11ffaae None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.345856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d4b2-19cd-48da-8fb6-015ad11ffaae None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.346177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859d4b2-19cd-48da-8fb6-015ad11ffaae None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.346992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.347640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 261/514] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:06.350261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859d4b2-19cd-48da-8fb6-015ad11ffaae None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.357468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9227-41e2-472e-a67e-1b23f8c13f56 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.363106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.395873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.396520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.396801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.397074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.397743 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.399207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e0b57a8f-9c65-4c47-bdbb-d7d2b687edaa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:06.411482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:06.412688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:06.413933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 254/515] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:06.414739 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad2e6-a462-49f7-a4db-a3cc94aed33b None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.415664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad2e6-a462-49f7-a4db-a3cc94aed33b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.415960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ad2e6-a462-49f7-a4db-a3cc94aed33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.436818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-be7ad2e6-a462-49f7-a4db-a3cc94aed33b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:06.438685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-be7ad2e6-a462-49f7-a4db-a3cc94aed33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:06.471529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859d4b2-19cd-48da-8fb6-015ad11ffaae None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.510364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 255/516] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:06.511314 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.511607 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.511895 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.512707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.513022 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.513460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.513856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.514616 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:06.515042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.516528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.533698 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:06.534115 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 262/517] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:06.534998 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.535441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:06.610210 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 256/518] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:06.617332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.618444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.649650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d453-d59b-4382-b05f-517d26e5d87e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.653507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.692914 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.693779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.694224 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.694635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.695457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:06.695929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.697448 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.703181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 263/519] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:06.710199 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.772081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41948661-5ed4-4614-86eb-5cdc179b9370 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.807401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.808042 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.808322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.808597 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.815548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.817018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:06.828929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:06.829891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:06.830768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 257/520] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:06.831242 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.873870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8dbf-66fe-4f81-b1c9-222dee235798 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:06.909993 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:06.910609 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:06.910890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:06.911166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:06.911803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:06.912105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:06.913511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:06.914901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.921644 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 264/521] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:06.922480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:06.923679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:06.986488 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50564e-952c-44f2-b6fa-f4c726ec8df1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.029465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.030117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.030399 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.030674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] PATH_INFO: `/v3/services/network` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.031363 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.032791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:07.042441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:07.043800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:07.044851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:07.048693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 258/522] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:07.049778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.079788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4654e-9d30-4ba4-bb99-c7f5fe9636af None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.120836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.122024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.122305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.122577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.123639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:07.123639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.125258 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.140098 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 265/523] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:07.141020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.180842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96323e9-811f-44ca-9817-b5e381df62aa None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.209549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:07.220152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.220895 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.221211 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.221487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.233186 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.234933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.237620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:07.253723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:07.254869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:07.255755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:07.255755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:07.255755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:07.255755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 259/524] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:07.256131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.264431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216e01-1889-4570-9dad-376f1eef7ce5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.311379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.313071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.313797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.314223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.315156 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:07.315634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.317861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.324961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 266/525] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:07.325946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.367594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33c6d-6364-41fd-a439-4ddfa98f6082 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.402798 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.403526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.404128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.404282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.406308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=a583664454f04a79a0f43a418a9f1778, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.407927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.425201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:07 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:07.426767 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.455569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b01a3-69e0-4982-9582-30508d2ac6b1 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.484281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:07.498414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.499598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.500024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.500501 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.501380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:07.501975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.503558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.509230 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:07.520388 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 267/527] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:07.526428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:07.608717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e3927-f54a-43d2-ad9d-a19e8f242727 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.675157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.676182 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.676693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.677259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.678118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:07.678623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.680970 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a2e8-1b2f-4750-8aaf-76e3c4dc30ed None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.687773 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 261/528] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:07.697087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6a093-648b-4233-b531-30126359fe31 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:07.737996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:07.738614 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:07.738893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:07.739208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:07.739816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:07.743202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f071e-b6ce-49e5-82a2-5d0c6b7a0f87 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:07.770344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 268/529] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:09:07 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:08.729948 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664a73-3ea3-4127-87b8-662d3c450743 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:08.731067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664a73-3ea3-4127-87b8-662d3c450743 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:08.731558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664a73-3ea3-4127-87b8-662d3c450743 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:08.733450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 262/530] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:08.738297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86839b2c-7022-4d21-b9b4-9b70b022f20c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:08.739121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86839b2c-7022-4d21-b9b4-9b70b022f20c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:08.739620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86839b2c-7022-4d21-b9b4-9b70b022f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:08.770155 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-86839b2c-7022-4d21-b9b4-9b70b022f20c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:08.771742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-86839b2c-7022-4d21-b9b4-9b70b022f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:08.809933 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:08.864477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 269/531] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 04:09:09.379144 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbfab9-9851-4227-93c6-b278b9a3a957 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:09.379826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbfab9-9851-4227-93c6-b278b9a3a957 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:09.380298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbfab9-9851-4227-93c6-b278b9a3a957 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:09.382155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 263/532] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:09.392014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbfab9-9851-4227-93c6-b278b9a3a957 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:09.403975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:09.404549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:09.409181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:09.450456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:09.451644 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:09.630683 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 270/533] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:09.653808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbfab9-9851-4227-93c6-b278b9a3a957 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:09.684172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:09.706676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:09.707570 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:09.708092 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:09.708554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:09.719494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:09.724561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:09.725527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:09.726355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:09.729143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 264/534] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:09.734749 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:09.859005 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:09.864132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224f26-bb7f-4640-8d61-23b16da6bad8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:09.910200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:09.911151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:09.911645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:09.912113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:09.912966 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:09.917508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:09.919183 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:09.929200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:09.930127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 271/535] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:09.948077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.060141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0cc8-0f55-4ae6-b17f-f2124726ab93 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.106247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.106915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.107196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.107474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.125047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:10.126643 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:10.133499 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44e80-21e1-4ca8-823a-909c2f5c1636 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:10.157368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:10.158408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:10.159338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:10.159338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:10.159338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:10.164436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 272/536] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:10.165456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.178572 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.179193 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.179479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.179749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.180435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:10.181882 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308047fd-3a9f-475d-b170-358db8ca0948 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:10.195085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:10.213281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 265/537] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:09 2022] POST /identity/v3/services => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:10.284044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90287-d5cd-4d17-896c-c3f526ef85f7 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.284563 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90287-d5cd-4d17-896c-c3f526ef85f7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.284869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b90287-d5cd-4d17-896c-c3f526ef85f7 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.287245 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 266/538] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:10.292749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.293634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.294045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.322760 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4521f-1143-413d-9b20-689a194bce9e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.349623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:10.352365 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:10.399138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:10.416438 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.417080 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.417385 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.417655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.418881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:10.419184 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:10.420634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa6a7-5b9e-4e64-899e-517153401fa5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:10.443862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 267/539] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:10.444357 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 273/540] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:10.451714 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.537504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087afc7b-674e-41a3-b118-5c3ac8c7d96b None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.537824 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087afc7b-674e-41a3-b118-5c3ac8c7d96b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.538077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087afc7b-674e-41a3-b118-5c3ac8c7d96b None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.539566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 274/541] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:10.545335 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.545619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.545899 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.563798 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e135d-f9d6-42ac-8e4e-985bae898c33 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.566967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:10.568350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:10.607341 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.608002 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.608283 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.608594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.618112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:10.620747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:10.637421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:10.638438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:10.639359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:10.641207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 268/542] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:10.644916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.658353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:10.679462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 275/543] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:10.688518 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:10.733641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.799707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aac91b-f78a-4acb-b0c6-8e4ac2a228f7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.848446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.849362 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.849649 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.849928 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.851356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:10.851674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:10.853421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f23d9-ca86-4fb2-946e-248473f1cb54 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:10.854326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4561788-b342-43a8-a61b-20119cd1e4d3 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:10.878541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 269/544] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:09:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:10.879784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33443f7-2e08-4330-825c-d3fda56d9875 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.880072 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33443f7-2e08-4330-825c-d3fda56d9875 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.880408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33443f7-2e08-4330-825c-d3fda56d9875 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.885206 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 270/545] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:10.885988 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33443f7-2e08-4330-825c-d3fda56d9875 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:10.903885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:10.904681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.904971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.905292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.919332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-94b87273-fbad-4830-9f49-01e88b6aae27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:10.925700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:10.926657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:10.927474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 276/546] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:10.928626 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:10.928813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:10.929908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:10.952168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:10.954006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:10.992112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.007646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33443f7-2e08-4330-825c-d3fda56d9875 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.019791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.037601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 277/547] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 04:09:11.037601 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.054301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.054987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.055273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.055545 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.068213 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.069825 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:11.085587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:11.086560 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:11.087447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:11.087447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.087447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:11.091688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 271/548] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:11.092509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.150111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555edab-ad2e-4175-95e4-dde833debc6c None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.191494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.192344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.192771 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.193214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.194283 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:11.195168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.197096 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.201115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480505b-1b11-448a-bc80-dadfd5a1798c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.209163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 278/549] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:11.210315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.237159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.237854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.238242 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.238616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.246396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.251448 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:11.257172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:11.258300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:11.259405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:11.266888 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 272/550] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:11.267846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.277943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.341604 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc7ff-c494-44af-af16-4b64f2f8c471 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.378144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.378773 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.379056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.379325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.379977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:11.380277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.381693 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.387237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf035a-340b-476f-a921-6a09e577c6d0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.393538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 279/551] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:11.394355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.427584 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.428120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.428398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.428942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.440160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.441479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:11.455835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:11.456781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:11.458035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:11.458035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.458035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:11.458035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 273/552] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:11.458035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.504034 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d8e6-33bf-4edd-a91b-ebe6dcfac30e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.512163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.515202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.540394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.541000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.541309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.541582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.542240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:11.542544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.543977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.556385 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 280/553] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:11.556385 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.568119 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc724-7ac4-4b76-998f-604d9c18af26 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.602312 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.602912 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.603186 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.603454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.604483 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.606061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.625225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 274/554] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:11 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:11.625225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.672239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195032-ada5-487e-b79f-187420fb48e3 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.726459 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.727484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.727963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.728400 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.738104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1043f-969a-4b50-9201-b66fa7ea8612 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.738533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.740512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.753359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:11.764131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:11.765520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:11.766568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:11.769738 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 281/555] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:11.770907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.788539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.789382 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.789765 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.790141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.790927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:11.791332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.792902 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.806904 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 275/556] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:11.808182 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.810506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:11.902466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9a8b-c1e8-435b-b047-51a5a751259b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.928798 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2a84-aed4-4959-8f7b-12f14cb9f57a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:11.954062 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.954700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.954981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.955253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.967906 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:11.968714 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:11.969191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:11.969604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:11.969763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.970582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:11.971030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:11.971201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.972915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:11.987063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 276/557] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:11.988253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:11.989164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:11.990072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:11.990945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:11.990945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:11.990945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:11.990945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 282/558] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:11.996918 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.029411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.106466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.108091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d195-a219-40df-89cf-2c35556c040f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.132460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b1a6b-aac4-4433-aa6f-f5acd246b87b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.144791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.145770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.146248 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.146717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.155296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.157033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:12.169548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:12.170509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:12.171440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:12.173366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 277/559] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:09:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:12.174364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.185161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.185161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.185161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.185161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/15838b36537140b7a402b54722e4594e/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.185557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=15838b36537140b7a402b54722e4594e, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.187104 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.206146 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 283/560] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:11 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/15838b36537140b7a402b54722e4594e/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:12.206982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.380521 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.394782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3871-0cc7-4f5d-bf2a-e00bfa41c41f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.400264 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36930-90fa-4233-82b5-ded5e48ec590 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.438100 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.438725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.439004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.439295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.440375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:12.440692 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.442156 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.444565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.446313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.446823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.447289 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.448136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:12.448638 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.450699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.453661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.465578 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 284/561] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:12.474120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.474263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 278/562] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:12.479978 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.581067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a0da-b4f1-42c7-b5ca-67f4a2c6b97c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.623001 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.624002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.624480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.624958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.642872 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47084e4-a2e6-49d7-81de-fa2ae0da4629 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.694930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.699133 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.702190 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa7384-0013-4ccd-845d-16119259866f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.713774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.714580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.714692 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.715057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.734273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.735717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-c91d9bb2-87c3-4484-bbb3-79d09c890fec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:12.748620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:12.749598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:12.750535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:12.753149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 279/563] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:12.754775 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e5236-cb27-4a5f-a3de-e2577c779782 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.755339 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e5236-cb27-4a5f-a3de-e2577c779782 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.755814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e5236-cb27-4a5f-a3de-e2577c779782 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.761568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 280/564] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:12.763298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e5236-cb27-4a5f-a3de-e2577c779782 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.780904 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.807200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 285/565] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:09:12.808528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.808810 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.809078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.827833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:12.828988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:12.883846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e5236-cb27-4a5f-a3de-e2577c779782 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:12.912212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 286/566] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:12.914180 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:12.930342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:12.930342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:12.930342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:12.930342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:12.930724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:12.930724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:12.930724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:12.958398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 281/567] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:12.963254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:12.964551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.037867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36b54c-4572-4950-bc02-e64e0a2b1812 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.073985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.075018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.075532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.076011 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.086338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.088018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:13.103464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:13.104665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:13.105641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:13.105641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:13.105641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:13.107705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 287/568] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:13.114053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.162408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.223362 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442dd1b-484e-4d0e-b952-a42cd6e9b8b9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.260557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.280619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.281653 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.282139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.282748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.289063 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a32c-3957-48e8-aa4a-abeff00273ea None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.295303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.297118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:13.312361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:13.313438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:13.314343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:13.314343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:13.314343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.316609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 282/569] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:13.317647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.334929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.335907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.336384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.336910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.338082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:13.338608 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.340688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.362186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 288/570] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:13.362186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.430606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29142-d09f-4555-8acd-7c48ae1e0d42 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.455721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.472622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.473673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.474151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.474647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.475426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.477014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:13.486942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:13.487950 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:13.488800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.489549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200081a5-025b-456a-adcb-8006f861dd0f None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.496457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 283/571] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:13.497571 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.528290 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.529067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.529643 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.529926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.530573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:13.530933 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.532904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.541659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.551585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 289/572] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:13.551585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.614779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bcb5c-b683-45fb-8180-375699c74238 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.653148 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.654145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.654758 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.655224 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.662735 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.664586 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.671923 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b1f2e-f3a3-4ced-bad3-f50f86d0991a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:13.677247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:13.678130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:13.679013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.686914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 284/573] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:13.688021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.715930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.717066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.717583 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.718070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.719190 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:13.720048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.721945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.732705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 290/574] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:13.733928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.745047 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.811464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:13.816842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11603d99-2b92-4f9a-99d7-b9abd0eb1397 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.862451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.863109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.863391 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.863634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa00b-a613-4e1e-b1f4-f0d6078b2b24 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:13.863765 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.873165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.875184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:13.890808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:13.891747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:13.892805 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:13.896916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 285/575] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:13.897929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:13.910522 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:13.911433 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:13.912344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:13.912820 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:13.914182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:13.914947 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:13.916675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:13.941350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 291/576] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:13.942598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.010915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56561d0b-64e6-46a2-88f2-7e26efa5436c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.019730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:14.047884 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.048492 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.048781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.049053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.049717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:14.050021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.051401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.054603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0571961-0de7-4d1b-8d04-3a906d27a7d7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.057282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 286/577] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:14.058140 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.085028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:14.099560 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.100191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.100470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.100740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.101457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:14.101874 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.104048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d56ec-90aa-4024-942b-479fadda5906 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 292/578] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae218e-2477-4d5a-af8c-86cdf3c126eb None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae218e-2477-4d5a-af8c-86cdf3c126eb None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae218e-2477-4d5a-af8c-86cdf3c126eb None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 293/579] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:14.123106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae218e-2477-4d5a-af8c-86cdf3c126eb None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.174370 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd68a1-0105-45e7-9487-8b5f73157770 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.212450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.212986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.213296 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.213571 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.214307 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=a583664454f04a79a0f43a418a9f1778) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:14.214609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.216105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.221906 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:14 2022] GET /identity/v3/role_assignments?user.id=a583664454f04a79a0f43a418a9f1778&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:14.225335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.244116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae218e-2477-4d5a-af8c-86cdf3c126eb None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.262482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:14.291719 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.292767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.293312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.293815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.295016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] RBAC: Adding query filter params (interface=public, service_id=58506b1fc3d44500867112afed4e1208, region_id=RegionOne) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:14.296004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.297941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babeb8a-313a-48d4-89c5-4aefcec87a8a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.308460 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 294/581] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:14 2022] GET /identity/v3/endpoints?service_id=58506b1fc3d44500867112afed4e1208&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:14.310269 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4c30-4f0d-41d0-9c7d-6081daa717c4 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.310763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4c30-4f0d-41d0-9c7d-6081daa717c4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.311237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de4c30-4f0d-41d0-9c7d-6081daa717c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.336650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-a3de4c30-4f0d-41d0-9c7d-6081daa717c4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:14.338925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a3de4c30-4f0d-41d0-9c7d-6081daa717c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:14.343807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f4e-dbe0-4f57-82a3-cc459cd76db7 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.382373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.383095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.383367 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.383645 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a9324eec4b3f44d186c1a426a9e01387/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.400606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=a9324eec4b3f44d186c1a426a9e01387, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.402078 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:14.402211 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.421181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 288/582] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:14 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a9324eec4b3f44d186c1a426a9e01387/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:14.421181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.435350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 295/583] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:14.532614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:14.554238 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fa7-1bd6-4cfa-9e2c-96e86ae19695 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.598072 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.598774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.599054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.599327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.600016 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.601478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ddb51-7cbd-47b0-b1e8-1089cb1a4fa5 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.608414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 289/584] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:14 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:14.679144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58156e36-6af5-4037-928c-fe8a6c226bd4 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.679479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58156e36-6af5-4037-928c-fe8a6c226bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.679676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58156e36-6af5-4037-928c-fe8a6c226bd4 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.681313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 296/585] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:14.687789 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.688102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.688350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.726417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:14.727651 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:14.763523 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58156e36-6af5-4037-928c-fe8a6c226bd4 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:14.846537 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 290/586] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:14.909591 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58156e36-6af5-4037-928c-fe8a6c226bd4 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:14.946574 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:14.947215 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:14.947497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:14.947772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] PATH_INFO: `/v3/services/network` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:14.948367 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:14.950298 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:14.961491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:14.962558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:14.963442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 297/587] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:14 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:14.968647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.086641 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:15.119974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f5487-a968-49e3-8ffe-239a5a7e0c1f None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.163819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.166295 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.166913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.167194 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.167462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.168207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] RBAC: Adding query filter params (name=network) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:15.168508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:15.169914 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:15.175060 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 291/588] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:15.180472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.271121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:15.284587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb60498-f400-4768-bee7-7d00e9b2632c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.333109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.333937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.334423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.334868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.335711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:15.336165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:15.338491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:15.345685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 292/589] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:15.351569 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.369506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:15.391083 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3f1c-0f5a-4dda-af2a-fedeb866c40b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.428394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.429307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.429754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.430447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.444800 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:15.452333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:15.453565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:15.454598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:15.458305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 298/590] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:15.465891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.584972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83348b-1f66-423b-96a1-6d9af711896d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.589436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:15.608602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ae0e-17ed-4fc3-90a8-25d5da6411a8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.653435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.654518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.655916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.656336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.658099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:15.659722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:15.662568 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:15.678959 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.680028 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.682037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 299/591] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:15.682464 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.682908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.683926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] RBAC: Adding query filter params (interface=public, service_id=0329eaec9c534afe9f26fa75f294ded5, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:15.684380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:15.685920 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:15.694581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/endpoints?service_id=0329eaec9c534afe9f26fa75f294ded5&interface=public®ion_id=RegionOne => generated 194 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:15.700841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.705539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:15.790297 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:15.827118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f46b-6b4b-4448-939b-c5effe90cb29 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.864507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.865484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.865988 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.866445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:15.867196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:15.868702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:15.874945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 294/593] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:15.935817 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d27f-4993-4440-8eba-fe6164052197 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:15.990928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:15.991590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:15.991871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:15.992144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.009393 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:16.010883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:16.031116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:16.032126 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:16.033024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:16.033024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:16.033024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:16.034550 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 300/594] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:16.037949 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:16.171243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7515d38-f08a-434c-89f0-21290557a655 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:16.208946 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:16.210405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.210891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.211366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.212220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:16.212739 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:16.214430 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:16.216747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:16.229868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 295/595] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:16.235068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:16.259121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:16.395421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364df919-d42f-49a8-9f80-e8412067579e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:16.436965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:16.437878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.438309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.438792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.446947 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:16.448590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:16.460655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:16.461838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 04:09:16.463003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:16.465065 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 301/596] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:16.470997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:16.591470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9cf0c-dc08-4784-983d-5e9cf7915f45 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:16.638427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:16.639279 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.639730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.640167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.641078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:16.641553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:16.643132 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9140-6756-4d80-876d-e508d6a9da40 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:16.666578 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 296/597] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Oct 13 04:09:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:16.672571 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:16.786446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:16.811916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6b3cd-e9d2-49c1-a486-c0d21642fee7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:16.861585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:16.862204 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.862486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.862760 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.869396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1aa1-c010-49fa-8d6b-2830f215e30a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.869685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1aa1-c010-49fa-8d6b-2830f215e30a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.869960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1aa1-c010-49fa-8d6b-2830f215e30a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.872090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 297/598] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:16.880452 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c5bc-3bb8-46c7-920b-3bad15b3e85a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:16.880743 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c5bc-3bb8-46c7-920b-3bad15b3e85a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:16.881026 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c5bc-3bb8-46c7-920b-3bad15b3e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:16.910873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d6e8c5bc-3bb8-46c7-920b-3bad15b3e85a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:16.912966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d6e8c5bc-3bb8-46c7-920b-3bad15b3e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:16.962185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:16.963986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:16.984275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.013613 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 298/599] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:17.017167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e74ee-48f4-46dc-bc0d-68b2b06e143e None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.017167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e74ee-48f4-46dc-bc0d-68b2b06e143e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.017167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e74ee-48f4-46dc-bc0d-68b2b06e143e None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.017167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 299/600] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:17.021982 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.022258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.022526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.054604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:17.055722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:17.088291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.137835 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 302/601] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:09:17.142975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.206894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 300/602] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:17.291296 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38712fbd-714b-47af-a401-23bdde779ecd None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.322455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.351363 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.351805 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.352085 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.352360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.376342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.376342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:17.400127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:17.401099 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:17.402032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:17.402032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:17.402032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:17.402032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 303/603] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:17.410017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.450878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6869e-68d4-4799-b6e6-90c4c4e32ec5 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.473477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.482507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.491208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.492020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.492442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.492876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.504706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:17.510952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:17.512109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:09:17.513139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:17.515392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 301/604] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:17.521719 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.616734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37fbcf-b46d-4995-a442-dcf97fea7c36 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.650655 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968860-c672-4375-a56a-fe9bbf2eb948 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.658902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.659517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.659794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.660525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.661200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:17.661506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.662876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.675208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 304/605] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:17.677315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.692874 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.693517 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.693905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.694184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.694842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:17.695142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.696494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934981d-cf1e-4021-91e5-b038dcddf048 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.706636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 302/606] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:17.709068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872f40-dc5d-4f79-9246-5f821ce803e6 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.709633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872f40-dc5d-4f79-9246-5f821ce803e6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.710165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872f40-dc5d-4f79-9246-5f821ce803e6 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.712759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 303/607] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:17.713785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872f40-dc5d-4f79-9246-5f821ce803e6 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.762921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.766545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:17.779826 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c8c0-2486-4a3d-9dd6-f1f4b5c767e5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.813703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.814549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.814988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.815263 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.815845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.817303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:17.827301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:17.828414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:17.829912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 305/608] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:17.830737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:17.836040 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872f40-dc5d-4f79-9246-5f821ce803e6 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.870444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.871043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.871382 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.871665 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.878229 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.879661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-5726759a-7251-49a2-bc2e-ed7dad8838d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:17.892048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:17.892932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:17.893893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:17.897280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 304/609] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:17.899389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.899878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.900360 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.920657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:17.921864 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:17.939340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6eb5-9499-4e13-9529-c9f08d0d02fd None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:17.976750 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:17.977473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:17.977758 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:17.978030 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:17.990680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:17.992123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:17.997369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 305/610] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:17.997369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:18.017688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:18.018842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:18.019916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:18.019916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:18.019916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:18.022402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 306/611] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:18.023558 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.024147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.030001 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.125832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab89c08-439f-4a97-b947-5061c11e5715 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.149000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed695-77a2-4184-9575-02b62b81c38b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.173115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.174135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.174501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.174846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.175796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.176177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.178401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.189764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 306/612] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.189764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.194222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.194222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.194474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.194768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.195528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.195908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.197440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.211314 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 307/613] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.212398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.287408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.292142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.300921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e9bc-8b2f-4c4f-8033-33bf751a6d53 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.338042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1bde-af0b-489e-b61e-57ff6600a990 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.342486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.343105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.343385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.343656 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.344303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.344604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.346022 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.358500 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 307/614] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.363529 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.375365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.376035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.376402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.376510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.377187 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.377506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.378970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.384375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 308/615] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.394200 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.479851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bef1d7-7a52-4a64-9146-473cae076ff2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.526935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.528604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.529170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.529633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.530894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=15838b36537140b7a402b54722e4594e) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.531436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.534266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.553160 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 308/616] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/role_assignments?user.id=15838b36537140b7a402b54722e4594e&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.553396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e423ca-dc45-481a-a6b2-96736fef4bcb None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.553493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.572875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.588863 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.600965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.601648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.602292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.602292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.602772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.604403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-ab75545c-bf11-4301-9b81-46614c9383db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:18.615659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:18.616727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:18.617641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 309/617] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:18.618437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059f63-f323-43b0-8cb8-c43881ac727b None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.619031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059f63-f323-43b0-8cb8-c43881ac727b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.619031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059f63-f323-43b0-8cb8-c43881ac727b None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.625079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 310/618] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:18.625079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c059f63-f323-43b0-8cb8-c43881ac727b None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.701209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e6046-efe3-40d4-b775-dac2bf90ee31 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.758513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.759158 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.759493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.759763 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.769000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.770514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.770634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c059f63-f323-43b0-8cb8-c43881ac727b None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-9a568347-a953-49b0-9432-24d619a404b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:18.782506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:18.783675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:18.784644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 309/619] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:18.785256 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.789817 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.790116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.809387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:18.810590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:18.811638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:18.812590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:18.813048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:18.816289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:18.816289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:18.816289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:18.817327 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:18.823651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 311/620] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:18.829716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.895496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.905345 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 310/621] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:18.906155 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:18.908449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:18.988691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322f94-735f-4d14-a68a-8e594e9e868e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.025687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.026351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.026633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.026910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.028329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:19.028639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.037154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.049154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 312/622] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:19.054344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.079703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe16522-eb1f-4c39-81e5-5a6e2c879b5a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.164931 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.165574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.165852 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.166123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.166814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:19.167116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.169054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.179818 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940d3e-91ca-447b-bb32-2c3bf364901a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.183593 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 311/623] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Oct 13 04:09:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:19.194131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.200035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:19.231930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.232786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.233069 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.233782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.285701 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:19.317029 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.319207 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.341452 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051ed1-5874-44bc-b78e-cefbc74a957a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.382463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.383917 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.384429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.384911 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.385841 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.388028 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.414760 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 312/624] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:19.416031 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.473703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 313/625] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 04:09:19.479654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.510994 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:19.634139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215417-4397-42ad-9f44-20efadfee9d5 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.650861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138317-bd49-4d46-a542-ff7b8d246bc4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.655854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:19.684886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.685577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.685853 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.686123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] PATH_INFO: `/v3/services/network` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.686754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.688156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:19.698601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:19.700135 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 04:09:19.701115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:19.701940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.702043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 313/626] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:19.702120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.702120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.702120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.704944 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.717724 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.719188 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:19.738008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:19.739739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:19.740932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:19.740932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:19.740932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:19.740932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 314/627] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:19.745616 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.841531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:19.866911 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dc87-4ffc-4568-8b7f-3e4cb377688a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.907980 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088eff4-6e3a-413a-975f-c307eff25b12 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:19.935244 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.935896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.936224 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.936497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.938168 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:19.938471 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.942825 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:19.953256 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 314/628] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:19.958201 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:19.977921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:19.978537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:19.979064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:19.979332 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:19.979972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:19.980301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:19.981742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.009649 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 315/629] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:20.014111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:20.053548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:20.108954 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a052b-b977-4026-b4c7-ff2e97b64ff3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:20.148661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48eab-4074-4436-bfd3-6eee609a8ad2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:20.155590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:20.156202 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.156476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.156746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.157409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:20.157712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:20.159127 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.164403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 315/630] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:20.170646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:20.177044 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:20.192485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:20.193470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.194016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.194504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.206695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:20.208442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:20.220338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:20.221259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:20.222170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:20.224576 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 316/631] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:20.230037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:20.345028 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606ff43-bb54-4409-a661-0beff1a741f8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:20.358995 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:20.403567 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:20.404223 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.404444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.404715 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.405490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:20.406889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.428630 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 316/632] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:09:20.451397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f627251-fe1f-498d-b70b-52059a588846 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:20.522479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:20.523517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.524019 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.524486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.525450 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:20.525973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:20.528395 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895561-56e9-4013-a52d-d370d06d2d9e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.542569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 317/633] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:20.548408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:20.686898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5dd77-a8e4-44bd-a59c-edaa319fcbe8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:20.723954 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:20.724582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.724858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.725147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.725976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=a9324eec4b3f44d186c1a426a9e01387) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:20.726288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:20.727778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ea91-cbfd-4a2c-b359-71d3efbda381 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:20.735251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 317/634] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:20 2022] GET /identity/v3/role_assignments?user.id=a9324eec4b3f44d186c1a426a9e01387&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:20.859383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2ce5-bca6-495b-88a1-21e055333c4d None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.860035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2ce5-bca6-495b-88a1-21e055333c4d None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.860508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2ce5-bca6-495b-88a1-21e055333c4d None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.862496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 318/635] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:20.868219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a039-b9e6-4d31-979e-d4203eb96d49 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:20.868520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a039-b9e6-4d31-979e-d4203eb96d49 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:20.868779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2a039-b9e6-4d31-979e-d4203eb96d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:20.896249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-69f2a039-b9e6-4d31-979e-d4203eb96d49 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:20.897544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-69f2a039-b9e6-4d31-979e-d4203eb96d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:20.927617 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:20.978550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 318/636] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:21.013667 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e4e6-6810-4a4b-b039-92ba61d178bb None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.013945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e4e6-6810-4a4b-b039-92ba61d178bb None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.014222 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e4e6-6810-4a4b-b039-92ba61d178bb None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.015836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 319/637] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:21.021260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.021724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.022142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.040514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:21.041962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:21.112999 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 319/638] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:21.269700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e4e6-6810-4a4b-b039-92ba61d178bb None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:21.317786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:21.378234 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e4e6-6810-4a4b-b039-92ba61d178bb None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:21.394869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:21.417589 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:21.418686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.419358 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.419870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.420638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:21.422502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:21.444922 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 320/639] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:21 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:21.503063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:21.514401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711cdd2-96bf-45a8-8f22-8772e906d881 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:21.561927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:21.562659 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.563037 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.563411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.564206 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:21.565852 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:21.575663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:21.576929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:21.577894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:21.578918 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 320/640] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:21.584942 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:21.694993 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc0f84-1eed-4e92-a8c5-a7ae51fff473 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:21.696824 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:21.734504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:21.735127 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.735410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.735684 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.736379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:21.736686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:21.738088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe45f-e092-4137-9703-90928964e0ee None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:21.743070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 321/641] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:21.748703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:21.852738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa901a-5043-4923-97a1-13ef4199dc91 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:21.887818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:21.888428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:21.888748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:21.889027 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:21.889692 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:21.889992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:21.891416 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7bce7-c88c-4a80-8b3d-6ea23164c64e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:21.896265 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 321/642] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:22.050336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5350d8-1d48-4f7b-a1e3-8e8ab73798a5 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.050732 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5350d8-1d48-4f7b-a1e3-8e8ab73798a5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.050908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5350d8-1d48-4f7b-a1e3-8e8ab73798a5 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.052616 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 322/643] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:22.059066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.059702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.060181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.080031 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:22.081561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:22.092605 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:22.157420 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 322/644] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:22.420110 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5350d8-1d48-4f7b-a1e3-8e8ab73798a5 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:22.525378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5350d8-1d48-4f7b-a1e3-8e8ab73798a5 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:22.559519 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:22.560216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.560497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.560770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.561383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:22.562734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:22.571580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:22.572546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:22.573417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 323/645] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:22.581212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:22.684250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16995c-072d-4a0a-9215-790bb2cae007 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:22.719427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:22.720409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.720896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.721400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.722271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:22.722780 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:22.724336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d38ac2-9715-422e-91e5-ee3e1ea9df03 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:22.729807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 323/646] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:22.735659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:22.767445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:22.842689 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc12ea-1034-4022-b249-12c1e47ab9bd None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:22.879671 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:22.880358 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.880639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.880908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.881593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:22.881894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:22.883393 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b9da4-4532-4a84-a5bd-1ddaf2190262 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:22.889355 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 324/647] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:22.994108 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21dc16-1927-44ea-8eda-453d21a0525a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:22.994407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21dc16-1927-44ea-8eda-453d21a0525a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:22.994572 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21dc16-1927-44ea-8eda-453d21a0525a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:22.996742 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 324/648] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:23.002367 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.002677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.002918 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.022657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:23.023874 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:23.096042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 325/649] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:23.365334 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21dc16-1927-44ea-8eda-453d21a0525a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:23.377377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:23.474076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21dc16-1927-44ea-8eda-453d21a0525a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:23.509117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:23.509796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.510205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.510475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.520985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:23.525741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:23.526661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:23.528394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 325/650] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:09:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:23.535454 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:23.561251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:23.639169 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953176-e28f-4af9-b14d-89cfb317fef4 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:23.677370 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:23.678000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.678272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.678540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.679226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:23.679526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:23.680950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb57d8-0615-482c-9654-ea8ed0067df8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:23.691325 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 326/651] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Oct 13 04:09:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:23.697285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:23.774266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:23.791233 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eab3b-4385-4632-b493-bdf4aa9599ee None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.792168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eab3b-4385-4632-b493-bdf4aa9599ee None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.793177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eab3b-4385-4632-b493-bdf4aa9599ee None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.796131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 327/652] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:23.800367 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.800946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.801399 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.810994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9251-9d76-426b-a6b1-ea21fab0e2d8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:23.821336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:23.822681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:23.849353 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:23.850360 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:23.850908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:23.851394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:23.863561 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:23.865538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:23.881259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:23.882250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:23.883146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:23.883146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:23.883146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:23.885285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 326/653] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:23.891387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:23.903403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 328/654] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:23 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:24.006838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb620-f849-4ddd-ac8e-5e93a7e46495 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.028774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.047083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.048166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.048690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.049313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.050212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:24.050734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.052486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd05583-333c-447f-82f2-eed9702f4fde None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.067235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 327/655] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:24.075007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.093281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.172035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c013d-7e57-4648-9da6-8fd8d4c1833f None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.172386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c013d-7e57-4648-9da6-8fd8d4c1833f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.172603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c013d-7e57-4648-9da6-8fd8d4c1833f None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.174134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 328/656] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:24.179054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.179337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.179618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.188930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cedb7-a29d-4545-9416-d3a4ddfbc8f2 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.198274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:24.199575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:24.225847 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.226538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.226819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.227088 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.234603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.236046 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:24.248453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:24.249610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:24.250577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 329/657] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:24.251217 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.281302 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 329/658] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:24.281302 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.350698 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.379135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe3264-c91d-41c0-9ddc-e9d92c95d229 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.415633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25fa0-2cb9-4be3-9f9e-c12c0b92f9a3 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.417931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.419676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.420187 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.420654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.421476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.423095 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.427466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:24.437424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:24.438376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:24.439250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:24.441924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 330/659] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:24.448488 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.460397 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.461409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.461703 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.461983 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.462724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:24.463057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.466121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.490261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 330/660] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:24.498128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.572502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a81e-bf32-4e8c-b1ab-58bda2401067 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.600232 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e454b-8b87-4fbc-b83e-072c1e199a4f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.610409 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.611373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.611658 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.611936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.612881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:24.613219 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.614587 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.619225 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 331/661] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:24.619947 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.624205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.641999 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.642644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.642925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.643200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.653507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.654977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:24.670045 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:24.671081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:24.671993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:24.671993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:24.671993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:24.671993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 331/662] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:24.671993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.697938 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.732138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af5e7-3410-43ae-aca2-2f6e19a8660d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.768699 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.769341 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.769628 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.769906 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.770564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.772190 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.780520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9811-d6e0-498a-8c6a-eec5fd2e8d98 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.796345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 332/663] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:24 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:24.796345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.827693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.828315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.828640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.828912 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.829693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:24.830093 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.831516 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.837535 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 332/664] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:24.843245 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:24.871457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.925779 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24a2c-b8d4-418a-9b1b-53dc185acd61 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.967847 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:24.969587 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:24.970703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:24.971239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:24.971743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:24.972687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:24.973235 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:24.976211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:24.996311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694d949-ee8b-4b8a-9a1a-efa4db57f617 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:24.996877 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 333/665] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:24.998193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:25.041509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.042113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.042389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.042734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.043449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] RBAC: Adding query filter params (interface=public, service_id=bc40c37883a74d0e99dcd98c38e2e0b4, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:25.043738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.045169 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.063321 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 333/666] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/endpoints?service_id=bc40c37883a74d0e99dcd98c38e2e0b4&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:25.069260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:25.123196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321981d-439a-4e98-852e-69dbef1748e8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:25.146518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:25.160010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.160642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.160924 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.161235 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.170050 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.171952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.182980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d25c1-71d4-4b4d-bcd1-1ec309fe492c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-9e8639a1-6462-4ec5-bb08-b0ccb65c8ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:25.184037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:25.185548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 334/667] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d661-af64-4ed4-9dcf-8b69920b1360 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.186768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d661-af64-4ed4-9dcf-8b69920b1360 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.187347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d661-af64-4ed4-9dcf-8b69920b1360 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.192177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 335/668] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:25.192960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d661-af64-4ed4-9dcf-8b69920b1360 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:25.227024 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.227547 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.227828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.228098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.228952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.230440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130bd8d-f18b-438a-9ad2-1b299c2ac648 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.236219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 334/669] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:25 2022] GET /identity/v3/services => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 04:09:25.237396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.237677 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.237956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.263600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:25.265041 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:25.267598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:25.344471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d661-af64-4ed4-9dcf-8b69920b1360 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:25.346081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 335/670] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:25 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:25.383982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.384600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.384878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.385179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.385939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:25.386240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.388266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.402843 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 336/671] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:25.408889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:25.520995 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739244-b8d5-4a38-b5e8-51cc31dfbc5d None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:25.556957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.558070 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.559129 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.559608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a9324eec4b3f44d186c1a426a9e01387/roles/9f527d0d265e4dbd8fcee519b7b923d2` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.562079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=a9324eec4b3f44d186c1a426a9e01387, role_id=9f527d0d265e4dbd8fcee519b7b923d2)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.563783 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7a25-1147-43c2-9a55-2722529dbb33 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.572315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:25.580884 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 336/672] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:25 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a9324eec4b3f44d186c1a426a9e01387/roles/9f527d0d265e4dbd8fcee519b7b923d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:25.615394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:25.669903 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:25.731763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f94fb-0833-4701-9496-7de38425d0d8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:25.771143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:25.771677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:25.771953 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:25.772224 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:25.772872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:25.774261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d904e9-823c-402f-b449-5ff4055f2660 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:25.790756 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 337/673] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:25 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:27.027790 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f30eb-2200-46e9-91ee-fa39071be2ab None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.028350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f30eb-2200-46e9-91ee-fa39071be2ab None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.028350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f30eb-2200-46e9-91ee-fa39071be2ab None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.029977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 337/674] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:27.035496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.035904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.036075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.054652 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:27.055835 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:27.130696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 338/675] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:27.394357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f30eb-2200-46e9-91ee-fa39071be2ab None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:27.509185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f30eb-2200-46e9-91ee-fa39071be2ab None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:27.545577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:27.546578 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.547067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.547576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.548377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:27.550012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-4c2f8775-d574-4389-9911-2708aba15742 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:27.560085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:27.561143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:27.561994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:27.564893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 338/676] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:27.570770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:27.590927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0334b-d4f8-41d4-bee7-f7419ed90ab0 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.591512 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0334b-d4f8-41d4-bee7-f7419ed90ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.592143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0334b-d4f8-41d4-bee7-f7419ed90ab0 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.593752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 339/677] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:27.599271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.599562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.599844 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.602165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:27.623514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:27.624705 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:27.678702 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345166f9-1e49-4795-bd90-a3a38af7008b None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:27.694203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:27.708327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 340/678] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:27.723436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:27.724274 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.724735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.725173 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.726014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:27.726487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:27.727989 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0d1f-c318-4263-9284-df1a94360485 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:27.739265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 339/679] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:27.740941 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:27.856459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1209c-5e27-484c-a6b5-f0dee5efabf6 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:27.864276 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147e1a-9537-4764-9a8a-b8cf5abeb461 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.864599 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147e1a-9537-4764-9a8a-b8cf5abeb461 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.865031 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f147e1a-9537-4764-9a8a-b8cf5abeb461 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.866790 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 340/680] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:27.872716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04140bfc-b85b-4359-aae0-4e76e82d7f30 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.873032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04140bfc-b85b-4359-aae0-4e76e82d7f30 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.873462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04140bfc-b85b-4359-aae0-4e76e82d7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.894331 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-04140bfc-b85b-4359-aae0-4e76e82d7f30 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:27.895739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-04140bfc-b85b-4359-aae0-4e76e82d7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:27.896016 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:27.896634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.896905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.897291 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.897892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:27.898266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:27.899632 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:27.905637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 341/681] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:27.912523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:27.979544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 341/682] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:27.980937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7b99-6054-4934-b819-316e5405f472 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.981285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7b99-6054-4934-b819-316e5405f472 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.981563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7b99-6054-4934-b819-316e5405f472 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.983053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 342/683] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:27.988647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:27.988945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:27.989252 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:27.993492 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.010171 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:28.011739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:28.030921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.034830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b61c-5e74-4c2c-99f5-7d7d78696407 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.069247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.069859 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.070140 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.070411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.071106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] RBAC: Adding query filter params (interface=public, service_id=1541f0ace58a436cb7e906591bca873d, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:28.071411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.072778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.078398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:27 2022] GET /identity/v3/endpoints?service_id=1541f0ace58a436cb7e906591bca873d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:28.079171 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.088927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 343/685] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:28.090952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.209068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c73f-f53b-4713-9883-4336368c6c3f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.216207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593231-21ef-470e-a0be-ee08c4e2b7f8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.241249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.255342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.255956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.256297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.256573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.256842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.257211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.257532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.257818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.258094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.258626 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.258721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.260059 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.273343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 344/686] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:09:28.273343 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:28.273600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:28.274508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.275466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 343/687] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:28.277879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.299700 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.399445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5c8c-366c-48fe-a4a7-624c1b680077 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.400139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bdbe2-4d67-4909-9538-5419497fa55f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.440648 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.441322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.441603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.441918 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.442666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:28.442801 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.442966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.443445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.443732 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.444008 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.444420 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.450865 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 344/688] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:28.450865 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.460352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:28.466293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:28.467638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 345/689] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:28.469161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.513473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.554315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.566967 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5582e-8ce4-44a6-a638-0e954c1b5d1e None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.578353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132de59-4b53-493c-96a3-241255eedd62 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.602572 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.603202 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.603480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.604009 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.604595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.606530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.615782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:28.616044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:28.616977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:28.618122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:28.618873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.618873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.618873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.618873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:28.618873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.619514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.621283 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 345/690] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:28.622799 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.624663 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 346/691] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:28.625767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.721539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455448-9527-4c7f-8c68-1dccede24ec0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.735074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.738227 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44af14-05fa-481d-b14e-f782fc0c9775 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.767504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.768123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.768398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.768678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.769373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:28.769675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.771032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.777014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.777825 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.778272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.778706 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.779048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 346/692] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:28.779637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:28.779818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.780216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.781609 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.789010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 347/693] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:28.789846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.803290 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:28.892253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fcb6-bfb7-4d17-9500-411acf8672f3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.895986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3a22-5603-4c69-98d9-63638373fc0b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:28.926678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.927295 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.927577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.927849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.928521 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.930159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.935137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:28.935775 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:28.936060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:28.936351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:28.947483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:28.949969 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:28.961386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 347/694] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:28.961386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:28.975726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:28.976792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:28.977766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:28.977766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:28.977766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:28.977766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 348/695] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:28.986411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.001932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.080424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.099026 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7329-6c33-4d04-95cf-c5c5e2fd056c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.132951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bcec-18c6-4919-98fb-2a51b3088ef4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.140946 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.141804 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.142262 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.142813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.143620 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:29.144070 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.148225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.153407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 348/696] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:29.160402 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.178004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.178661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.178928 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.179973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.179973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:29.180193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.181693 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.199783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 349/697] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:29.205137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.269504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.281603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe643486-e627-4436-8e0b-96003c4081e1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.326438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.327304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.327853 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.328275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.329123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] RBAC: Adding query filter params (interface=public, service_id=b549cd588bb84dbc805ee8aaf7400c57, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:29.329802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.330815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1d72e-f453-4729-a037-8926a78ec7e4 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.331508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.337300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 349/698] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/endpoints?service_id=b549cd588bb84dbc805ee8aaf7400c57&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:29.344191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.351783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.376450 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.377681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.378538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.378996 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.388853 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.390500 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:29.408202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:29.409372 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 04:09:29.410526 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:29.417859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 350/699] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:29.418987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.472194 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b43d2-62e3-4641-b981-4f97c9b9c282 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.516606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.517260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.517541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.517812 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.518423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.519854 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.528659 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 350/700] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:09:29.557491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92935ca-8a8d-4864-a0f1-d31f963f67ee None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.595444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.596416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.596921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.597426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.598338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:29.598846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.600479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.621921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 351/701] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:29.628050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.650827 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.743191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243216b7-072a-416a-a65d-20285f4bebb6 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:29.778168 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:29.779094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:29.779556 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:29.779999 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:29.848678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:29.850448 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:29.877966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:29.956493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 351/702] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:09:29.962408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:29.998143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:30.066351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f252e3-773f-428d-b205-b0c9e1efcf17 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:30.105747 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:30.106380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.106658 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.106929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.117193 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:30.118650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:30.134189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:30.135531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:30.136525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:30.136525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:30.136525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:30.136525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 352/703] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:30.142791 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:30.244286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491bed-3efe-4d6b-a41c-3edfb08913b8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:30.263336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:30.281496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:30.282476 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.282956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.283453 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.284367 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:30.284867 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:30.286468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:30.299035 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 352/704] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:30.305120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:30.399741 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:30.414418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ab4-5879-475f-a756-1be7d0b7d584 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:30.460821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:30.461907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.462423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.462897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.471878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:30.473778 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-9913d11d-7cbf-4de1-bec7-4d6f398e547f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:30.486875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:30.487838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:30.488713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:30.491084 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 353/705] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:30.497565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:30.562081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081314c-ffde-4c95-a044-c4672025343d None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.562369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081314c-ffde-4c95-a044-c4672025343d None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.562649 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081314c-ffde-4c95-a044-c4672025343d None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.564265 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 354/706] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:30.569213 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.569502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.569782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.588539 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:30.589752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:30.604615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7295-4887-4a21-a594-1060d9301b33 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:30.641810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:30.643042 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.643475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.643907 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.644775 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:30.645770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:30.647609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:30.663297 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 353/708] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:30.663463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 355/708] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:30.673347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:30.752982 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:30.775492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791e1bb-c469-4d57-b4e6-8624a1261087 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:30.811066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:30.811912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:30.812338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:30.812786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:30.813729 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] RBAC: Adding query filter params (role.id=9f527d0d265e4dbd8fcee519b7b923d2, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=a9324eec4b3f44d186c1a426a9e01387) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:30.814225 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:30.815789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:30.822264 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 356/709] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:30 2022] GET /identity/v3/role_assignments?user.id=a9324eec4b3f44d186c1a426a9e01387&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=9f527d0d265e4dbd8fcee519b7b923d2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:30.936470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:30.982956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:31.050992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba28b3-2a35-4362-9712-022cb17e464a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.086995 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.087667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.087949 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.088223 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.088831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.090849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-54048e17-fa1b-4e82-aaa1-000df84fc40e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:31.101010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:31.102097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:31.102935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 354/710] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:31.109143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:31.212926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b2ca9-22e7-48ae-ad26-3b2751b4d395 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.213451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b2ca9-22e7-48ae-ad26-3b2751b4d395 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.213451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b2ca9-22e7-48ae-ad26-3b2751b4d395 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.215395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 355/711] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:31.219579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2f358-26dc-4ba8-884b-607b1e71b7a1 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.221098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588088d-610a-4593-8526-656c52b29b4c None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.221509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588088d-610a-4593-8526-656c52b29b4c None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.221887 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588088d-610a-4593-8526-656c52b29b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.243335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d588088d-610a-4593-8526-656c52b29b4c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:31.243335 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d588088d-610a-4593-8526-656c52b29b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:31.258420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.259036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.259320 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.259599 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.260237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:31.260542 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.262076 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:31.268634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 357/712] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:31.274057 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:31.285015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:31.345221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 356/713] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:31.404068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f162cca-b413-4a5d-b5b8-2af592e7b206 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.439143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.440186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.440675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.441178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.442016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:31.442541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.444129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:31.450506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:31.456382 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588088d-610a-4593-8526-656c52b29b4c None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:31.489963 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:31.563542 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588088d-610a-4593-8526-656c52b29b4c None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.599876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.600851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.601413 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.601906 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.602807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.604650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:31.626566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:31.629185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 357/715] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:31.710053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:31.748634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fc21-6d73-4a48-9d66-4c3558f9a0fd None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.793314 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.793973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.794256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.794536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.795135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.796545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-a68fe10b-4e6d-4a42-bc14-667c2c69a6ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:31.806507 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:31.807580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:31.808971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:31.813371 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 359/716] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:31.814486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:31.834546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59aa1-af7d-4fc7-a653-341be5757187 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.835131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59aa1-af7d-4fc7-a653-341be5757187 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.835654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59aa1-af7d-4fc7-a653-341be5757187 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.837480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 360/717] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:31.842495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.842876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.843159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.864850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:31.866049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:31.935821 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:31.945096 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 361/718] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:31.954617 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840b47b-9fd8-4456-b7cb-45c9c11db978 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:31.991603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:31.992595 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:31.993085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:31.993609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:31.994446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:31.994956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:31.997150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.002526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 358/719] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:32.008579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:32.071721 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:32.116345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10268ff-0b83-4075-b768-4de0bcb3bf21 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:32.152510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:32.153559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:32.154051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:32.154544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:32.155382 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:32.155891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:32.157493 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.162962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 362/720] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:32.220673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:32.337509 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bba89-81e4-4ae2-8715-68ede8f30bcd None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:32.375195 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:32.375838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:32.376119 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:32.376391 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:32.376979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:32.378441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:32.387623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:32.388639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:32.389731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 359/721] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:32.397017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:32.511951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cde0ed-1f2a-4d19-a984-293836476ac8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:32.543559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:32.547811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:32.548428 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:32.548709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:32.548985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:32.549653 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:32.549960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:32.551324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.556557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 363/722] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:32.562917 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:32.584240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:32.675069 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2e8f-cf12-400a-955c-e1b727a0697b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:32.712886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:32.713809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:32.714813 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:32.715261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:32.716085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:32.716576 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:32.718120 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cc5f1-9109-4441-8592-7ab363b5d1ae None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.723562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 360/723] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Oct 13 04:09:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:32.729489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:32.831313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4f9f2-6411-4af8-9c31-ff6092c2c414 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:32.865378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:32.865917 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:32.866198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:32.866472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:32.867158 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:32.868519 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868670ac-b54d-45bf-b350-ce820f4cd97f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:32.897315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 364/724] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:33.138566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9c63-832b-4d85-85d0-8abbebdf133c None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.138913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9c63-832b-4d85-85d0-8abbebdf133c None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.139030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9c63-832b-4d85-85d0-8abbebdf133c None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.140737 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 361/725] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:33.146553 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.146901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.147105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.166194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:33.167415 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:33.208209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:33.244545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 365/726] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:33.519064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b9c63-832b-4d85-85d0-8abbebdf133c None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:33.602821 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:33.623921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b9c63-832b-4d85-85d0-8abbebdf133c None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:33.658889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:33.659527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.659803 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.660070 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.660714 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:33.662189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:33.671575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:33.672644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:33.673550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 362/727] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Oct 13 04:09:33 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:33.678731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:33.781682 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d5dd-a62d-43d3-834f-67380281b713 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:33.818940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:33.819557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.819836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.820107 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.820746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:33.821048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:33.822528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15387c6-938b-4a82-b7e9-a949fda145b2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:33.828959 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 366/728] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:33.834516 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:33.941697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a5e90-971b-42b7-ba23-078f8f3b4db1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:33.969495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e4cb7-da6a-4713-aace-b15ccc4bb0d5 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.969781 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e4cb7-da6a-4713-aace-b15ccc4bb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.970058 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e4cb7-da6a-4713-aace-b15ccc4bb0d5 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.973175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 367/729] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:33.977391 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fbc3-0f9d-4e49-8510-d7a85783ee2b None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.977864 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fbc3-0f9d-4e49-8510-d7a85783ee2b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.978240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3fbc3-0f9d-4e49-8510-d7a85783ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.982089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:33.982897 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:33.983327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:33.983746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:33.984523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] RBAC: Adding query filter params (type=image) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:33.984972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:33.987582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:33.993262 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 363/730] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:34.001962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c4f3fbc3-0f9d-4e49-8510-d7a85783ee2b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:34.003539 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c4f3fbc3-0f9d-4e49-8510-d7a85783ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:34.041639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:34.083873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 368/731] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:34.366741 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:34.379788 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:34.477164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdd49f-f322-48a1-a13a-fd0ebb9914cb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:34.505964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cdf7-a7c6-4cd5-9ee9-df755d686db0 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:34.506465 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cdf7-a7c6-4cd5-9ee9-df755d686db0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:34.506963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cdf7-a7c6-4cd5-9ee9-df755d686db0 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:34.508600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 369/732] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:34.514368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:34.514657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:34.514938 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:34.517479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259994-66f5-4170-8982-2be27723db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:34.518185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259994-66f5-4170-8982-2be27723db4b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:34.518472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259994-66f5-4170-8982-2be27723db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:34.518746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259994-66f5-4170-8982-2be27723db4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:34.519373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259994-66f5-4170-8982-2be27723db4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:34.520736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259994-66f5-4170-8982-2be27723db4b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-45259994-66f5-4170-8982-2be27723db4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:34.532197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:34.533252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:34.534089 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 364/733] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:34.534882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:34.535366 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:34.541359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259994-66f5-4170-8982-2be27723db4b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:34.619407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:34.631081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 370/734] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:34.653612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259994-66f5-4170-8982-2be27723db4b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:34.693065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:34.693745 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:34.694030 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:34.694357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:34.694996 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:34.695302 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:34.696673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:34.702019 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 365/735] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:34.707518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:34.804740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:34.813324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751023ca-55e7-4cee-adf6-3c312df305c6 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:34.848936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:34.849925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:34.850407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:34.850912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:34.851743 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:34.852245 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:34.854080 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:34.859541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 371/736] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:34.865533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:34.916147 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:34.977500 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e753-b868-4bc7-9192-40fe7aab83c8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:35.017559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:35.018627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.019143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.019619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.020526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] RBAC: Adding query filter params (interface=admin, service_id=1541f0ace58a436cb7e906591bca873d, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:35.021145 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:35.022976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:35.026303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:35.035451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 366/737] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Oct 13 04:09:34 2022] GET /identity/v3/endpoints?service_id=1541f0ace58a436cb7e906591bca873d&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:35.036702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:35.043916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299337af-f1e5-48b3-bf8c-0a4e9ad72627 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:35.085057 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:35.085487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.085768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.086041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.086713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:35.088189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068f4f1-e575-4f7f-9996-f25ea579d334 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:35.106606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 372/738] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:34 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:09:35.107868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67def4c-fbba-4b3d-ad66-d5b1d10c29ac None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.108179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67def4c-fbba-4b3d-ad66-d5b1d10c29ac None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.108420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67def4c-fbba-4b3d-ad66-d5b1d10c29ac None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.109821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 373/739] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:35.115389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.115754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.115975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.135893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:35.137786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:35.153549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:35.174465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8b2c2-1210-4b1c-a562-8c9bec696413 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:35.222470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:35.223162 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.223442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.223764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.224744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:35.226396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:35.233904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 374/740] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:35.239953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 367/741] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:35 2022] GET /identity/v3/services => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:09:35.508387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:35.611709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723943fb-b4d3-41c8-805c-55036ee63517 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:35.652256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:35.653251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.653750 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.654329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.655174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:35.656791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:35.659648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING keystone.server.flask.common [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 13 04:09:35.679340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.sql.core [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:35.679340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:09:35.679340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [parameters: {'id': 'a35c369e12d1460794d61b717557ef9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 04:09:35.679340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a35c369e12d1460794d61b717557ef9a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a35c369e12d1460794d61b717557ef9a. Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:35.688418 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 04:09:35.689220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application yield resource Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise self.value Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application session.commit() Oct 13 04:09:35.690218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.session.flush() Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application compat.raise_( Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 04:09:35.691120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 04:09:35.692013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:35.694310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [parameters: {'id': 'a35c369e12d1460794d61b717557ef9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:35.696529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:35.698401 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a35c369e12d1460794d61b717557ef9a. Oct 13 04:09:35.700647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:35.703550 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 375/742] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Oct 13 04:09:35 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:35.710113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:35.773308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:35.818676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829db4d-79b2-4045-bff2-8dd4d636a6a1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:35.855660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:35.856633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:35.857157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:35.857626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:35.865055 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:35.866979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-d6928707-88eb-4c09-83cb-1956a2598066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:35.879079 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:35.880071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:35.880964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:35.883106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 368/743] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:35.889811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:35.894586 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:35.998666 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293b54-cd9c-4721-87cf-05bfc34dfc2a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:36.034721 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:36.035710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:36.036266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:36.036735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:36.037651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:36.038224 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:36.040139 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0267-85f7-45e4-8c52-580db3f66b78 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:36.062280 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 376/744] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:36.321012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4322ea0-45cd-49a3-ae29-1d500d2a0a8e None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:36.321257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4322ea0-45cd-49a3-ae29-1d500d2a0a8e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:36.321541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4322ea0-45cd-49a3-ae29-1d500d2a0a8e None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:36.322883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 369/745] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:36.328562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c938d0-5f2e-4e58-bf41-422cfcb7cd71 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:36.328855 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c938d0-5f2e-4e58-bf41-422cfcb7cd71 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:36.329174 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c938d0-5f2e-4e58-bf41-422cfcb7cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:36.350308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f8c938d0-5f2e-4e58-bf41-422cfcb7cd71 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:36.351783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f8c938d0-5f2e-4e58-bf41-422cfcb7cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:36.414261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:36.423729 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 377/746] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:36.699824 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4322ea0-45cd-49a3-ae29-1d500d2a0a8e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:36.805796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4322ea0-45cd-49a3-ae29-1d500d2a0a8e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:36.828407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:36.842065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:36.843220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:36.843892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:36.844171 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:36.844841 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:36.846625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b16bbe-92c9-4987-8614-0d7b775c5be4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:36.873246 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 370/747] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:36 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:37.334811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178830f2-d191-40bf-a9a7-b6743801a4a5 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:37.335312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178830f2-d191-40bf-a9a7-b6743801a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:37.335415 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178830f2-d191-40bf-a9a7-b6743801a4a5 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:37.337086 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 378/748] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:37.343386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ec3cd-6e16-4dcc-bb34-41ae90bd28fc None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:37.343720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ec3cd-6e16-4dcc-bb34-41ae90bd28fc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:37.343945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ec3cd-6e16-4dcc-bb34-41ae90bd28fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:37.364628 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-7c6ec3cd-6e16-4dcc-bb34-41ae90bd28fc None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:37.365891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7c6ec3cd-6e16-4dcc-bb34-41ae90bd28fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:37.444625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 371/749] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:37.465821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41291-3faf-45d1-97b8-80bd23b46edd None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:37.466108 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41291-3faf-45d1-97b8-80bd23b46edd None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:37.466379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41291-3faf-45d1-97b8-80bd23b46edd None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:37.467971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 379/750] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:37.474699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:37.475108 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:37.475483 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:37.494395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:37.495835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:37.567302 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 372/751] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:37.711071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41291-3faf-45d1-97b8-80bd23b46edd None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:37.815527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41291-3faf-45d1-97b8-80bd23b46edd None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:37.849511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:37.850141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:37.850419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:37.850691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:37.851273 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:37.852647 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:37.861725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:37.862701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:37.863552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 380/752] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:37.871851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:37.874089 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:37.912942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:37.949687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:37.993320 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b83c44-3aef-4dcf-a6c9-e5cd9139b84b None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.005286 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c771-226d-456e-8a20-30ba0555a91e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.043579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.044541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.044969 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.045415 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.046177 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.047729 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:38.057882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:38.059138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 04:09:38.060043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:38.067803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 381/753] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Oct 13 04:09:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:38.069917 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.165736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.166793 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.167782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.168255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.169081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:38.169675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.171338 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.177408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 373/754] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:38.183280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.195185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d765e-70a2-4a8a-a9e2-951c9de0b2cc None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.219476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:38.234561 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.235487 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.235950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.236497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.237434 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:38.237956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.239580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.245907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 382/755] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:38.255232 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.306649 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:38.310532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91089-da46-4618-82d7-d4839abee548 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.351930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.352663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.353003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.353379 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.354344 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:38.355235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.356651 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80799c30-c074-41e7-9bf3-2f15d6004c0b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.364555 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 374/756] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:38.365875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2bf43-3573-47cd-ae08-5582d1be74ab None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.366164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2bf43-3573-47cd-ae08-5582d1be74ab None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.366440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2bf43-3573-47cd-ae08-5582d1be74ab None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.367683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 375/757] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:38.372273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2bf43-3573-47cd-ae08-5582d1be74ab None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.388671 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367155-6556-4946-a58c-069cbe2c8aa1 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.424562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.425241 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.425570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.425842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.426465 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:38.426815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.428206 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70f635-0a4d-4232-ba5b-8260db7a18b2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.437464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 383/758] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Oct 13 04:09:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:38.437464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.437464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.437464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.455478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:38.457030 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:38.481331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2bf43-3573-47cd-ae08-5582d1be74ab None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.510276 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:38.522749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.523454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.523801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.524136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.524898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] RBAC: Adding query filter params (interface=public, service_id=ef5549910c2d4549badfa7bf3e5b2005, region_id=RegionOne) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:38.525299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.527253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.536891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 376/759] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:38 2022] GET /identity/v3/endpoints?service_id=ef5549910c2d4549badfa7bf3e5b2005&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:38.536891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.537150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 384/760] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:38 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:38.546446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.567243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:38.641713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece669-c75a-4883-8c1c-9667601fbe16 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.680455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.681172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.681782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.681894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.683252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.684687 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.688868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a953f2-3b54-4199-9144-c6c6eb29cd55 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.703903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 377/761] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:38.736564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.737485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.737915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.738366 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.739146 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.740713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.753363 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 385/762] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:38 2022] GET /identity/v3/services => generated 1957 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:09:38.826315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:38.936418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:38.951657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325b6a-b230-4d4d-891f-f648a688ba61 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:38.990194 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:38.990835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:38.991111 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:38.991385 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:38.992057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:38.993604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:38.996352 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING keystone.server.flask.common [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 13 04:09:39.011726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.sql.core [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 04:09:39.011726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 04:09:39.011726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [parameters: {'user_id': '1efa0c0e713c41b9897e65262d2d0678', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 04:09:39.011726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1ab1ef0f-3250-403a-aed4-87111b9cbc1e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:39.019713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:39.020663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application yield resource Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise self.value Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application session.commit() Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 04:09:39.021679 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.flush() Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application compat.raise_( Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 04:09:39.022548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:39.023407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:39.024217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [parameters: {'user_id': '1efa0c0e713c41b9897e65262d2d0678', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:39.025049 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 13 04:09:39.027915 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.030104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 378/763] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Oct 13 04:09:38 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:39.037410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:39.081910 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:39.119236 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d3eb-f1a3-4dd2-9bfc-7b9b71f37d93 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.119573 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d3eb-f1a3-4dd2-9bfc-7b9b71f37d93 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.119794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d3eb-f1a3-4dd2-9bfc-7b9b71f37d93 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.124260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 379/764] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:39.130876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09149124-4771-4577-83cc-ef97520f41fe None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.131158 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09149124-4771-4577-83cc-ef97520f41fe None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.131597 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09149124-4771-4577-83cc-ef97520f41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.154232 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a41-4de1-4ddb-936a-a2ee3d0108f7 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:39.157503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-09149124-4771-4577-83cc-ef97520f41fe None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:39.159316 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-09149124-4771-4577-83cc-ef97520f41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:39.198639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:39.199287 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.199569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.199843 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.208871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:39.210411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:39.226537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:39.227546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:39.229456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 386/765] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:39.238169 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:39.245173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 380/766] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:39.340905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:39.344347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe35b-57c0-4001-a74f-05d334cc55a2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:39.379313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:39.379922 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.380202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.380473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.381182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:39.381489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:39.382900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:39.420113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 387/767] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:39.521274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09149124-4771-4577-83cc-ef97520f41fe None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:39.614181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:39.635146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09149124-4771-4577-83cc-ef97520f41fe None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:39.673536 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:39.674322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.674609 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.674883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.675474 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:39.676974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:39.686440 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:39.687496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:39.688331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:39.692816 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 381/768] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:39.694348 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:39.801477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37794-e712-4994-9fd6-4c240b0b9e43 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:39.835463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:39.836066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.836344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.836615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.837260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] RBAC: Adding query filter params (name=image) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:39.837564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:39.838930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:39.844333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 388/769] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:39.849764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:39.950759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58face-e5c8-4b48-869c-09d7b62ca1f3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:39.984386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:39.984994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:39.985308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:39.985581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:39.986209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:39.986514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:39.987877 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:39.992865 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 382/770] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:39.998759 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:40.023768 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:40.102477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa3bf-5fa4-42be-8fb9-99951af0492b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:40.138551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:40.139166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:40.139448 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:40.139722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:40.140421 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] RBAC: Adding query filter params (interface=public, service_id=58767e9f7aed49a6a9141590bdc0c09e, region_id=RegionOne) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:40.140730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:40.142131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7625-1126-4062-9464-5a97c6234d5d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:40.147250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 389/771] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:09:39 2022] GET /identity/v3/endpoints?service_id=58767e9f7aed49a6a9141590bdc0c09e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:40.152934 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:40.164473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:40.256051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116e8e-2e5c-497b-9f6e-4c775b264ce8 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:40.289544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:40.290154 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:40.290432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:40.290705 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:40.291306 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:40.293217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54f0f-d054-4f91-8b6d-4c69254b38f0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:40.299878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 383/772] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:09:40 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:09:40.986329 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161410cc-6c17-497d-8be9-81eb463bf4f7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:40.986896 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161410cc-6c17-497d-8be9-81eb463bf4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:40.987488 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161410cc-6c17-497d-8be9-81eb463bf4f7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:40.988898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 390/773] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:40.994363 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:40.994788 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:40.994961 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.014630 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:41.015886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:41.041685 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599834b-9229-4da2-8728-b15418a6b8db None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.041968 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599834b-9229-4da2-8728-b15418a6b8db None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.042766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599834b-9229-4da2-8728-b15418a6b8db None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.044092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 391/774] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:41.049004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.049358 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.049596 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.067753 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:41.068941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:41.088242 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 384/775] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:40 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:41.143987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 392/776] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:41 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:41.354081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:41.356502 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:41.412844 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:41.430878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:41.459454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996f7b9-350e-465a-877a-8ad00361c585 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:41.494118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:41.494749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.495023 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.495810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.496899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:41.498776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:41.505161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 385/777] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:41.506859 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:41.524623 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29660-0abb-4345-b8d1-79a927d106e8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:41.559506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:41.560122 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.560405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.560675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.561284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:41.562988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:41.571967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:41.572951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:41.573893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 393/778] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:41.578884 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:41.583377 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:41.616323 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87298-0871-4218-bf81-767df849cf5f None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:41.650442 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:41.651203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.652033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.652310 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.652968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:41.654425 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:41.664825 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:41.689161 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 386/779] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:09:41 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:09:41.689354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579084-bd58-490c-a87c-924a9babd839 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:41.726611 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:41.727242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.727525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.727800 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.728444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:41.729009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:41.730493 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:41.736280 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 394/780] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:41.742088 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:41.852474 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092d5c-beb1-4a2a-a299-d81aa9664e31 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:41.878993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:41.891068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:41.891682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:41.891965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:41.892234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:41.892871 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:41.893195 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:41.894727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e0d4-ec88-462b-8b79-4e5bdfe42735 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:41.900332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 387/781] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Oct 13 04:09:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:41.906324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:42.014305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e825-e3a9-43d4-b657-15e969ac6c5c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:42.048089 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:42.048703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:42.048985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:42.049304 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:42.049978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:42.051342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04c29a-a3f6-44f0-b9b7-79ab25319f8f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:42.068167 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:42.077273 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 395/782] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:42.442052 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f95-9aad-464f-94bb-5c7420fceeda None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:42.442566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f95-9aad-464f-94bb-5c7420fceeda None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:42.442642 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f95-9aad-464f-94bb-5c7420fceeda None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:42.444096 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 388/783] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:42.449431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:42.449725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:42.450006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:42.469328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:42.470505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:42.546391 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 396/784] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:42.812091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438f95-9aad-464f-94bb-5c7420fceeda None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:42.915358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438f95-9aad-464f-94bb-5c7420fceeda None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:42.950404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:42.951033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:42.951313 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:42.951579 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] PATH_INFO: `/v3/services/image` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:42.952163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:42.953566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:42.962438 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:42.963623 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:42.964568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 389/785] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Oct 13 04:09:42 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:42.970131 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:43.071770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889aa4-195d-4a77-8d00-124e4e22ff90 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:43.098001 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:43.107966 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:43.108632 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:43.108915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:43.109207 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:43.109893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] RBAC: Adding query filter params (name=image) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:43.110201 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:43.111570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:43.116447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 397/786] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:43.122616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:43.176447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:43.227278 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179cd1-5d07-42d1-8edc-e163fe63093c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:43.261602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:43.262204 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:43.262485 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:43.262754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:43.263380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] RBAC: Adding query filter params (type=image) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:43.263682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:43.265039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6817a0-5a6a-4752-b8b7-fe22d7a5ceaa None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:43.270107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 390/787] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:43.275521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:43.380643 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef136c7a-3380-417e-a67a-f75868c09577 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:43.415802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:43.416414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:43.416688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:43.416981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:43.417680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:43.419033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed461-fab1-4f3e-b459-d43c0fbf797d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:43.445176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 398/788] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:09:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:43.914435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdb6d-042b-4876-8eb2-d4ecfae532ec None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:43.914990 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdb6d-042b-4876-8eb2-d4ecfae532ec None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:43.914990 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdb6d-042b-4876-8eb2-d4ecfae532ec None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:43.916302 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 391/789] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:43.921940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ff2d-d3d9-4744-b48b-09369df7f7b0 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:43.922232 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ff2d-d3d9-4744-b48b-09369df7f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:43.922509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ff2d-d3d9-4744-b48b-09369df7f7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:43.941605 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-fff1ff2d-d3d9-4744-b48b-09369df7f7b0 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:43.942782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fff1ff2d-d3d9-4744-b48b-09369df7f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:43.985524 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:44.019627 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 399/790] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:44.288015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdb6d-042b-4876-8eb2-d4ecfae532ec None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:44.330921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5427ed-29f3-4e88-ab91-528548a5f502 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:44.332259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5427ed-29f3-4e88-ab91-528548a5f502 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:44.332541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5427ed-29f3-4e88-ab91-528548a5f502 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:44.334121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 400/791] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:44.339369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:44.339659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:44.339935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:44.359373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:44.360554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:44.402916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdb6d-042b-4876-8eb2-d4ecfae532ec None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:44.418963 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:44.434369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 401/792] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:44.440095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:44.440770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:44.441103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:44.441408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:44.442510 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:44.443965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:44.449174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 392/793] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:44.451313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:44.554776 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff990-3bc4-4ec7-ac75-e186235f7a14 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:44.556366 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:44.595457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:44.596070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:44.596354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:44.596632 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:44.597331 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:44.598785 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:44.633154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 402/794] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:09:44 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:09:44.720968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:44.836358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3b00f-7c48-494f-ae55-55e75dbdb723 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:44.872217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:44.872857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:44.873154 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:44.873429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:44.884115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:44.889428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:44.891183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:44.892046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 393/795] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:09:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:44.896635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.003216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fe9-a3e6-4c4d-a07b-f6f1ae714970 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.038745 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:45.039362 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.039646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.039922 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.040593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:45.040898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:45.042849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:45.052735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 403/796] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Oct 13 04:09:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:45.057651 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.103571 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:45.169368 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb532-133e-45ae-95b4-f8106585a0f2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.205738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:45.206388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.206669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.206942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.218214 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:45.219664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:45.236086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:45.237105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:45.238106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:45.238106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:45.238106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:45.243713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 394/797] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:45.243840 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.266533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:45.355508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec203-1754-423e-a0da-7a546399d8f2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.509667 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:45.510302 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.510579 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.511412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.512077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:45.512381 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:45.513807 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741d3b-98f0-4f19-87cc-281332c447f8 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:45.531756 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 404/798] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:45.533084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.611348 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d344c-f40b-4c72-89ae-68bfa79ee2f7 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.611551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d344c-f40b-4c72-89ae-68bfa79ee2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.611810 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d344c-f40b-4c72-89ae-68bfa79ee2f7 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.613518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 405/799] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:45.619185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.619482 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.619735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.638047 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:45.638984 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:45.639220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:45.646513 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c849-e832-4eba-866e-7c39e63a37ba None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.685662 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:45.686293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.686575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.686833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.694962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:45.696381 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:45.707738 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:45.708688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:45.709683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 395/800] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:09:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:45.712617 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 406/801] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:45.717118 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.817119 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b337c3-d0b7-48dd-ae6a-a93f89796510 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.850075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:45.850678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:45.850959 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:45.851231 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:45.851954 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:45.852257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:45.854050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:45.871835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 396/802] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:09:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:45.877404 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.889714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:45.977783 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:45.983387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ceb59-e325-412e-939a-6a5854feb3b6 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:45.993272 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:46.019873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.020504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.020778 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.021045 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.031373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.032801 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:46.047135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:46.048293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:46.049440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:46.049440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:46.049440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:46.049440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 407/803] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:46.055419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.083962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757a671-bc7d-4dea-adb6-236e580abbcf None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.117420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:46.117871 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.118480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.118762 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.119036 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.119744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.121794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.129462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.sql.core [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:46.129462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:09:46.129462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [parameters: {'id': '382d8fac2c084d7c9d6e9fd31dcbf34b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 04:09:46.129462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:46.136522 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 04:09:46.137410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application yield resource Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application next(self.gen) Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise self.value Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application session.commit() Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 04:09:46.139058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.session.flush() Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application compat.raise_( Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 04:09:46.139925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 04:09:46.140797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application conn.query(q) Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application result.read() Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 04:09:46.142748 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [parameters: {'id': '382d8fac2c084d7c9d6e9fd31dcbf34b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 04:09:46.144792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:46.146319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 397/804] 10.222.0.13 () {60 vars in 1137 bytes} [Thu Oct 13 04:09:45 2022] POST /identity/v3/domains => generated 190 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:46.147461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.172772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1daa55-60e9-4a59-ab19-ade14076a819 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.207037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.207807 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.208392 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.208684 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.209416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:46.209720 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.211077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.223569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 408/805] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:46.229102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.232278 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:46.256061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c49a-9821-4845-a909-8d9e92baffcb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.292433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.293063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.293387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.293662 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.303769 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.305250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:46.319725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:46.320688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:46.321664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:46.321664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:46.321664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:46.327654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 398/806] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:46.329085 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.343175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98a65-cda5-4d73-92a1-01c7dee45cb2 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.367255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:46.381434 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.381959 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.382241 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.382515 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.389988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.391425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:46.403845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:46.404752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:46.405707 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 409/807] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:46.410711 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.439394 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534bdc0-5d04-4fb1-8f76-379f37731bb9 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.467211 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:46.475732 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.476337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.476614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.477075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.477549 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:46.477932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.479955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.501177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 399/808] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:46.530410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688859-6ee1-4940-9c4a-c755b8985d2b None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.568272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.568897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.569218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.569493 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.570260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:46.570566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.572064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efda010-7ce1-40d1-9bbf-4bc6e719409f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.591783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 410/809] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:46.593406 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:46.702578 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433acdcf-e332-413f-a58c-4782a5d3f848 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:46.739519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:46.740184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.740459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.740723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/9f527d0d265e4dbd8fcee519b7b923d2` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.742892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=a583664454f04a79a0f43a418a9f1778, role_id=9f527d0d265e4dbd8fcee519b7b923d2)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:46.744301 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff327b7a-7b51-4bb4-b3e0-29f5214340d4 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:46.758333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 400/810] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:46 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/a583664454f04a79a0f43a418a9f1778/roles/9f527d0d265e4dbd8fcee519b7b923d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:46.928669 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6859a7-6943-4066-8c9f-7824a9665bee None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.928974 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6859a7-6943-4066-8c9f-7824a9665bee None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.929243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6859a7-6943-4066-8c9f-7824a9665bee None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.930577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 411/811] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:46.936050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:46.936337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:46.936612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:46.955008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:46.956119 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:47.000094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:47.024098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 401/812] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:47.291285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6859a7-6943-4066-8c9f-7824a9665bee None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:47.335943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:47.393419 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6859a7-6943-4066-8c9f-7824a9665bee None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:47.425709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:47.426335 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:47.426619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:47.426891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:47.437208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:47.441981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:47.443006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:47.444226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 412/813] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:47.449763 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:47.544454 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943d618-9293-4738-91bb-e866a6ed9a66 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:47.576895 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:47.577517 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:47.577796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:47.578066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:47.578722 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:47.579020 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:47.580379 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:47.588184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 402/814] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:47.594488 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:47.692976 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f052e2-d295-4daa-ae57-7f8677052980 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:47.694486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:47.726854 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:47.727475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:47.727752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:47.728020 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] PATH_INFO: `/v3/users/73b4a1bc9a83462988b3edbf256cdee7` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:47.740870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] RBAC: Authorizing `identity:get_user(user_id=73b4a1bc9a83462988b3edbf256cdee7)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:47.742327 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:47.743905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 413/815] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:09:47 2022] GET /identity/v3/users/73b4a1bc9a83462988b3edbf256cdee7 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:47.750174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:47.790288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:47.847225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755047-6496-491b-9bc8-07287bed25d0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:47.880015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:47.880644 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:47.880924 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:47.881225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:47.882321 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e9f29fb4934dea8043332ea888c0b4)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:47.883744 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac384ac-9081-4be8-9983-9e3d8381f709 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:47.886269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 403/816] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:09:47 2022] GET /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:47.891894 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:47.989073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c54491-27c9-4cea-9a2c-49c604c9d415 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:48.022137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:48.022789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:48.023070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:48.023345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4/users/73b4a1bc9a83462988b3edbf256cdee7/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:48.025255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9f29fb4934dea8043332ea888c0b4, user_id=73b4a1bc9a83462988b3edbf256cdee7, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:48.026755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa75da-2527-4a45-9d8e-7ce634a0b819 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:48.039011 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 414/817] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:47 2022] PUT /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4/users/73b4a1bc9a83462988b3edbf256cdee7/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:48.864449 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c0f0-3940-47cd-916b-46c69ebe6620 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:48.864980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c0f0-3940-47cd-916b-46c69ebe6620 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:48.864980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c0f0-3940-47cd-916b-46c69ebe6620 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:48.866372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 404/818] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:48.872142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:48.872589 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:48.872691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:48.892747 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:48.893964 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:48.908165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:48.958368 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 415/819] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:49.220109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c0f0-3940-47cd-916b-46c69ebe6620 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:49.322994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c0f0-3940-47cd-916b-46c69ebe6620 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:49.333074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:49.358232 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:49.358858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:49.359139 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:49.359411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:49.369408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:49.374209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:49.375322 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:49.376354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 405/820] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Oct 13 04:09:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:49.381323 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:49.475113 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ac76b-aaca-4b8e-a915-edba0a1a088a None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:49.507233 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:49.507818 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:49.508093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:49.508361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:49.509017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:49.509350 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:49.511221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:49.518687 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 416/821] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Oct 13 04:09:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:49.524248 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:49.623223 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ee3a-ab19-4e5f-b7bd-70bf6f70b066 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:49.655631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:49.656247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:49.656521 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:49.656787 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:49.666443 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:49.667886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:49.681724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:49.683414 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:49.684523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:49.684523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:49.684523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:49.685412 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 406/822] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:49.688972 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:49.704594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:49.790397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a77cdf-e49d-425c-970b-fdabb2ea5374 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:49.823969 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:49.824571 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:49.824853 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:49.825144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:49.825795 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:49.826101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:49.827467 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:49.838978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 417/823] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:49.844604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:49.866044 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:49.941846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0fc5e-70cc-409a-9c08-69abda750c71 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:49.974220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:49.974823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:49.975096 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:49.975364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:49.983653 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:49.985076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-203a7030-72c8-491b-beb0-2d2bf206ae9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:09:49.995823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:49.996896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 04:09:49.998317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:50.001428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 407/824] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Oct 13 04:09:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:50.002677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.074763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.103630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b23d7-e0c5-47b4-b43f-e58e7252f874 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.136070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.136669 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.136945 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.137242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.137959 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:50.138256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.139657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.156544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 418/825] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:50.157922 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdef70-0ca6-44d2-b17f-2c3189ec34a6 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.158282 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdef70-0ca6-44d2-b17f-2c3189ec34a6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.158627 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdef70-0ca6-44d2-b17f-2c3189ec34a6 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.160043 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 408/826] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:09:50.161941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.165314 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.165596 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.165868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.183724 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:50.184936 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:50.250286 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 409/827] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:09:50.259564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022776bf-b4fb-48d8-8039-1ba3d10c41a0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.286944 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.293396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.294000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.294277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.294544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.362470 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.363900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.456554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 419/828] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:09:50.462246 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.474332 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.523751 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.553620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.559761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd1334-8848-4ab7-813b-47f77ad279b1 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.594478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.595026 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.595303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.595607 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.605618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.607076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:09:50.622156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:50.623254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:09:50.624342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:09:50.624342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:09:50.624342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:50.624554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5e69-6c08-4ba9-9b9c-422b93505e5e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.624645 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 410/829] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:50.630383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.660595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.661259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.661541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.661815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.674229 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:09:50.679967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:50.680983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:09:50.681999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 420/830] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:09:50.687794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.691255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.731130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbae31-7d89-4b0d-a58c-f3b738b0ba7c None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.763829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.764423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.764696 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.764962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.765636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:50.765929 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.767306 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.778495 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 411/831] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:50.778631 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.784094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.788537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebad9-7823-40cc-a842-4f7a46c44015 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.822705 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.823838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.824118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.824389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.825046 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:50.825377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.826733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.834435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 421/832] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:50.840450 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.881207 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9146e2-916b-4aad-9e2a-79a44eb5bba0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.902877 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:50.914641 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.915270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.915556 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.915832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.922833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.924262 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:09:50.936099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:09:50.937173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:09:50.938263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 412/833] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:09:50.941693 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180705c-2c6d-42a0-9edd-37bc2c1d23c0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:50.942905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:50.974677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:50.975398 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:50.975682 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:50.975959 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] PATH_INFO: `/v3/users/73b4a1bc9a83462988b3edbf256cdee7` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:50.977098 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] RBAC: Authorizing `identity:get_user(user_id=73b4a1bc9a83462988b3edbf256cdee7)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:50.978562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:50.980905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 422/834] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/users/73b4a1bc9a83462988b3edbf256cdee7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:50.986941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:51.007930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:51.039587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985611ad-4b30-4c38-a9ff-b8b3a1138724 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:51.072165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:51.072792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:51.073628 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:51.073905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:51.074596 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:51.074899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:51.076327 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:51.084303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40579d8f-886f-4f3b-9a24-28bcc84e0f11 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:51.087821 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 413/835] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:51.094014 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:51.118840 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:51.119438 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:51.119716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:51.120043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:51.135622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:51.187294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:51.188727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:51.190896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a45c4-d4e5-4689-851f-3efeb886c631 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:51.210565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:51.225530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:51.226131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:51.226407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:51.226676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:51.227395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] RBAC: Adding query filter params (role.id=9f527d0d265e4dbd8fcee519b7b923d2, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=a583664454f04a79a0f43a418a9f1778) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:51.227704 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:51.229413 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:51.235102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 414/836] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:51 2022] GET /identity/v3/role_assignments?user.id=a583664454f04a79a0f43a418a9f1778&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=9f527d0d265e4dbd8fcee519b7b923d2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:09:51.291414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 423/837] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:09:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 04:09:51.297480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:51.405078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd105-785c-4e84-a36b-162dba849052 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:51.412258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:51.442720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:51.443352 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:51.443628 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:51.443897 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:51.445004 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e9f29fb4934dea8043332ea888c0b4)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:51.446495 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794929-82ee-4890-9f7f-906f7d184a73 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:51.448706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 415/838] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:09:51 2022] GET /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:51.454850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:51.551976 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332d26-f001-42e8-a59d-481eaac6fd39 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:51.571510 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:51.586077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:51.586685 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:51.586965 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:51.587243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:51.587963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=e2e9f29fb4934dea8043332ea888c0b4, user.id=73b4a1bc9a83462988b3edbf256cdee7) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:09:51.588271 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:51.589880 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065c603-589e-439a-9fa9-686de60a3fb7 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:51.595872 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 424/839] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:09:51 2022] GET /identity/v3/role_assignments?user.id=73b4a1bc9a83462988b3edbf256cdee7&scope.project.id=e2e9f29fb4934dea8043332ea888c0b4&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:53.727490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69b25-0bdf-41e3-a528-2f1361e7a3dc None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:53.728032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69b25-0bdf-41e3-a528-2f1361e7a3dc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:53.728032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69b25-0bdf-41e3-a528-2f1361e7a3dc None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:53.730216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 416/840] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:53.735349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:53.735746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:53.735900 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:53.753747 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:53.754917 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:53.819112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 425/841] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:54.085080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d69b25-0bdf-41e3-a528-2f1361e7a3dc None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:54.183415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d69b25-0bdf-41e3-a528-2f1361e7a3dc None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:54.216654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:54.217309 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:54.217590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:54.217864 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:54.218956 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:54.220380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a898864-1edf-4c37-9e64-bff5b694521b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:54.221980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 417/842] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:09:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:54.227635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:54.322618 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc793-f7fe-44c1-8539-c064b601007b None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:54.336733 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:54.357288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:54.357886 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:54.358163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:54.358434 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:54.359077 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:54.360489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1af7-7761-423d-9020-a9acc10b44a3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:54.380476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 426/843] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:09:54 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:09:56.509938 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88333f76-129c-43ed-ab05-276ba2c65d32 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:56.511057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88333f76-129c-43ed-ab05-276ba2c65d32 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:56.511057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88333f76-129c-43ed-ab05-276ba2c65d32 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:56.512333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 418/844] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:56.517666 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:56.518074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:56.518218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:56.535898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:56.537064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:56.600948 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 427/845] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:56.867795 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88333f76-129c-43ed-ab05-276ba2c65d32 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:56.910298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:56.967637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88333f76-129c-43ed-ab05-276ba2c65d32 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:57.000797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:57.001444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:57.001725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:57.001997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] PATH_INFO: `/v3/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:57.003378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] RBAC: Authorizing `identity:get_role(role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:57.004775 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:57.006138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 419/846] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:09:56 2022] GET /identity/v3/roles/a3fc537dd6f9468895373cc15d975f81 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:57.011889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:57.102802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:57.105907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d4200-c32e-4b98-aa3c-90f1b1bc7fb7 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:57.140277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:57.140841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:57.141115 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:57.141412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] PATH_INFO: `/v3/users/88bf029287e04565a916f9c74f2f4904` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:57.153639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] RBAC: Authorizing `identity:get_user(user_id=88bf029287e04565a916f9c74f2f4904)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:57.155043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:57.156576 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 428/847] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:09:57 2022] GET /identity/v3/users/88bf029287e04565a916f9c74f2f4904 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:57.162107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:57.258555 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1c242-be6f-4a8a-b856-a5653fafb664 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:57.268798 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:57.292208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:57.292822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:57.293099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:57.293403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:57.294493 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e9f29fb4934dea8043332ea888c0b4)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:57.295903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baf639-6a41-430b-9e8b-12f2fbf9b9d2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:57.297530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 420/848] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:09:57 2022] GET /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:09:57.303277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:09:57.398445 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3b081-8871-443a-9bb7-173d0ac25283 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:09:57.431377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:09:57.432021 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:57.432321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:57.432595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4/users/88bf029287e04565a916f9c74f2f4904/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:57.434771 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9f29fb4934dea8043332ea888c0b4, user_id=88bf029287e04565a916f9c74f2f4904, role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:09:57.436226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f95e86-c1be-48b0-853f-36c48594c61f None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:09:57.448837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 429/849] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:09:57 2022] PUT /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4/users/88bf029287e04565a916f9c74f2f4904/roles/a3fc537dd6f9468895373cc15d975f81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:09:59.542729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5db4-6c68-4374-8aff-c0328c30f792 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:59.543273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5db4-6c68-4374-8aff-c0328c30f792 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:59.543273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5db4-6c68-4374-8aff-c0328c30f792 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:59.544580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 421/850] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:09:59.549841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:09:59.550237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:09:59.550389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:09:59.568566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:09:59.569757 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:09:59.583070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:09:59.634442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 430/851] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:09:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:09:59.903455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5db4-6c68-4374-8aff-c0328c30f792 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:00.003526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5db4-6c68-4374-8aff-c0328c30f792 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:00.036340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:00.036958 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:00.037277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:00.037555 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] PATH_INFO: `/v3/roles/a3fc537dd6f9468895373cc15d975f81` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:00.038946 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] RBAC: Authorizing `identity:get_role(role_id=a3fc537dd6f9468895373cc15d975f81)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:00.040315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:00.042203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 422/852] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:09:59 2022] GET /identity/v3/roles/a3fc537dd6f9468895373cc15d975f81 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:00.047936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:00.141679 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0de0-d9af-4798-a080-1a43d09e1ed3 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:00.174052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:00.174661 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:00.174934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:00.175202 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] PATH_INFO: `/v3/users/88bf029287e04565a916f9c74f2f4904` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:00.176295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] RBAC: Authorizing `identity:get_user(user_id=88bf029287e04565a916f9c74f2f4904)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:00.177726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:00.179248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 431/853] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:10:00 2022] GET /identity/v3/users/88bf029287e04565a916f9c74f2f4904 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:00.184796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:00.229170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:00.282456 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8f062-20d2-40cb-ab8c-4516065662be None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:00.314777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:00.315426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:00.315708 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:00.315984 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:00.381577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:00.383017 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:00.425998 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:00.477021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 423/854] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:10:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:00.483726 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:00.501036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:00.579484 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad4b8-7089-49a0-b0fd-6c27ad82e001 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:00.611927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:00.612540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:00.612817 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:00.613087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] PATH_INFO: `/v3/projects/e2e9f29fb4934dea8043332ea888c0b4` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:00.614223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e9f29fb4934dea8043332ea888c0b4)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:00.615633 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae3be-c088-4ba9-8e48-2a834f04a685 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:00.617235 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 432/855] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:10:00 2022] GET /identity/v3/projects/e2e9f29fb4934dea8043332ea888c0b4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:00.623174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:00.718497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be11c0-4edb-402d-af68-db0b5094a9d2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:00.751253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:00.751857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:00.752126 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:00.752398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:00.753117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] RBAC: Adding query filter params (role.id=a3fc537dd6f9468895373cc15d975f81, scope.project.id=e2e9f29fb4934dea8043332ea888c0b4, user.id=88bf029287e04565a916f9c74f2f4904) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:00.753451 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:00.754865 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d387472-9e48-4671-ae9a-7ffccb8aa795 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:00.760959 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 424/856] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:10:00 2022] GET /identity/v3/role_assignments?user.id=88bf029287e04565a916f9c74f2f4904&scope.project.id=e2e9f29fb4934dea8043332ea888c0b4&role.id=a3fc537dd6f9468895373cc15d975f81 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:02.855986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7acde-9254-43b9-bfc5-041221215485 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:02.856535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7acde-9254-43b9-bfc5-041221215485 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:02.856535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7acde-9254-43b9-bfc5-041221215485 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:02.857890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 433/857] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:02.863241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:02.863640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:02.863799 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:02.881977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:02.883144 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:02.885841 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:02.946957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 425/858] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:03.213489 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7acde-9254-43b9-bfc5-041221215485 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:03.294563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:03.311198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7acde-9254-43b9-bfc5-041221215485 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:03.344178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:03.344798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:03.345074 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:03.345375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:03.346471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:03.347893 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089dfe3-e5b2-4345-bd42-cee8049dcf80 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:03.349477 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 434/859] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:03.355464 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:03.449835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b67f65-1d9e-4c57-9187-bef6619b34ec None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:03.481746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:03.482281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:03.482558 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:03.482827 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:03.483463 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:03.484872 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163eea-d8a1-48e9-b4e8-fdb795159bb3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:03.495846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:03.511270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 426/860] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:10:03 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:10:05.636315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082ce4-2854-4fc7-a543-ce64ac2ffbde None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:05.636827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082ce4-2854-4fc7-a543-ce64ac2ffbde None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:05.636827 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082ce4-2854-4fc7-a543-ce64ac2ffbde None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:05.638149 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 435/861] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:05.643574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:05.649432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:05.649432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:05.662808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:05.663981 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:05.728086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 427/862] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:05.999865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082ce4-2854-4fc7-a543-ce64ac2ffbde None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:06.098797 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082ce4-2854-4fc7-a543-ce64ac2ffbde None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:06.130766 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:06.131374 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:06.131649 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:06.131936 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:06.133016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:06.134452 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d07b0a-5574-4c7f-8c28-947b33cc67d4 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:06.136816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 436/863] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:06.142388 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:06.235616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aefe78-036f-41c2-a914-900deda331ea None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:06.256781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:06.268773 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:06.269392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:06.269668 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:06.269933 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:06.270580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:06.271989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ea5e-c400-470c-8fab-a70516dfe1d9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:06.292705 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 428/864] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:10:06 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:10:08.426886 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78acd-f528-43b5-b242-93e85215910f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:08.427436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78acd-f528-43b5-b242-93e85215910f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:08.427436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78acd-f528-43b5-b242-93e85215910f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:08.428739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 437/865] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:08.434380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:08.434814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:08.434908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:08.453048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:08.454249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:08.517472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 429/866] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:08.779246 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f78acd-f528-43b5-b242-93e85215910f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:08.800642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:08.877439 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f78acd-f528-43b5-b242-93e85215910f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:08.909266 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:08.909877 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:08.910150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:08.910416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:08.920727 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:10:08.925584 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:10:08.926718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:10:08.927879 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 438/867] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:10:08.934573 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:09.028569 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953409a-47a3-4e81-9c40-e0680325920e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:09.037364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:09.063258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:09.063849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:09.064126 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:09.064395 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:09.065051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:09.065380 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:09.066735 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:09.074434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 430/868] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:09.080079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:09.157710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:09.177280 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c204-2f58-49b3-b2f8-32d6d86183e3 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:09.208971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:09.209610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:09.209883 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:09.210150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] PATH_INFO: `/v3/users/e5d224c940a041d3aa81afdc6eb560ae` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:09.223012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d224c940a041d3aa81afdc6eb560ae)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:09.224416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:09.226000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 439/869] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:10:09 2022] GET /identity/v3/users/e5d224c940a041d3aa81afdc6eb560ae => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:09.232268 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:09.328948 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762c17-58b7-4671-bfb6-1d9b89851add None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:09.361172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:09.361794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:09.362071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:09.362342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] PATH_INFO: `/v3/projects/8583d62ac4844124b0f1af6d28c92ee6` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:09.363424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8583d62ac4844124b0f1af6d28c92ee6)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:09.364839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0efe76-0504-4d1a-b2b5-05de5c4172e5 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:09.366460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 431/870] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:10:09 2022] GET /identity/v3/projects/8583d62ac4844124b0f1af6d28c92ee6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:09.373049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:09.466478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b5c-9d27-4bd2-b995-ceecbf410390 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:09.498925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:09.499559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:09.499834 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:09.500102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] PATH_INFO: `/v3/projects/8583d62ac4844124b0f1af6d28c92ee6/users/e5d224c940a041d3aa81afdc6eb560ae/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:09.501970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] RBAC: Authorizing `identity:create_grant(project_id=8583d62ac4844124b0f1af6d28c92ee6, user_id=e5d224c940a041d3aa81afdc6eb560ae, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:09.503377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20303b6-8a40-4a21-8c58-5937c997a068 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:09.511223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:09.516573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 440/871] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:10:09 2022] PUT /identity/v3/projects/8583d62ac4844124b0f1af6d28c92ee6/users/e5d224c940a041d3aa81afdc6eb560ae/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:10:11.609240 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117d20-07b5-4a09-9563-919baebcb463 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:11.609750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117d20-07b5-4a09-9563-919baebcb463 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:11.609750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f117d20-07b5-4a09-9563-919baebcb463 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:11.611034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 432/872] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:11.616356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:11.616821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:11.616925 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:11.634505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:11.635693 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:11.698427 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 441/873] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:11.963406 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f117d20-07b5-4a09-9563-919baebcb463 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.003649 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:12.062316 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f117d20-07b5-4a09-9563-919baebcb463 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.093965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.094575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.094851 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.095122 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.105410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:10:12.110064 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:10:12.111152 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:10:12.112183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 433/874] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:10:12.116943 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.210260 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb262-928c-4c25-b57e-c7c5b1280993 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.235761 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:12.243393 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.243978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.244278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.244546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.245227 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:12.245527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:12.246865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:12.254431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 442/875] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:10:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:12.260025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.354619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:12.358792 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b8eae-181e-4517-b314-98f5bf440ffd None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.392269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.392962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.393291 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.393566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] PATH_INFO: `/v3/users/e5d224c940a041d3aa81afdc6eb560ae` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.394715 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] RBAC: Authorizing `identity:get_user(user_id=e5d224c940a041d3aa81afdc6eb560ae)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:12.396200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:12.397785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 434/876] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:10:12 2022] GET /identity/v3/users/e5d224c940a041d3aa81afdc6eb560ae => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:12.403494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.498657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae7ba-62d4-4a62-bb9e-fff21f432c3e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.530310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.530897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.531171 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.531467 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.585321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:12.596011 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:12.597479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:12.690291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 443/877] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:10:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:12.696019 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.792275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdc05-3e3d-4f40-aa6a-ad7113a2903a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.824199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.824811 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.825087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.825391 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] PATH_INFO: `/v3/projects/8583d62ac4844124b0f1af6d28c92ee6` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.826475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] RBAC: Authorizing `identity:get_project(project_id=8583d62ac4844124b0f1af6d28c92ee6)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:12.827893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f1a6-9ed6-42ac-af1b-eeb124212451 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:12.829514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 435/878] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:10:12 2022] GET /identity/v3/projects/8583d62ac4844124b0f1af6d28c92ee6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:12.835518 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:12.920930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:12.930387 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a540-73dc-495d-a60e-49db6bb3c9d5 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:12.961882 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:12.962471 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:12.963232 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:12.963502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:12.964210 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=8583d62ac4844124b0f1af6d28c92ee6, user.id=e5d224c940a041d3aa81afdc6eb560ae) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:12.964514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:12.965939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aaff2-e3fc-41b8-8e8f-266a7a440f72 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:12.971384 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 444/879] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:10:12 2022] GET /identity/v3/role_assignments?user.id=e5d224c940a041d3aa81afdc6eb560ae&scope.project.id=8583d62ac4844124b0f1af6d28c92ee6&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:15.081237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fd49d-f90a-42f4-82ae-308faad11916 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:15.081765 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fd49d-f90a-42f4-82ae-308faad11916 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:15.081765 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fd49d-f90a-42f4-82ae-308faad11916 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:15.083098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 436/880] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:15.088760 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996e3-de65-4d0c-bca7-1034338f81d0 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:15.089198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996e3-de65-4d0c-bca7-1034338f81d0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:15.089339 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996e3-de65-4d0c-bca7-1034338f81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:15.107278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e66996e3-de65-4d0c-bca7-1034338f81d0 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:15.108444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e66996e3-de65-4d0c-bca7-1034338f81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:15.171770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 445/881] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:15.438839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fd49d-f90a-42f4-82ae-308faad11916 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:15.473682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:15.538109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fd49d-f90a-42f4-82ae-308faad11916 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:15.570675 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730248cb-192d-4547-a246-5733043c847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:15.571261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730248cb-192d-4547-a246-5733043c847a None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:15.571536 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730248cb-192d-4547-a246-5733043c847a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:15.571801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730248cb-192d-4547-a246-5733043c847a None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:15.572450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730248cb-192d-4547-a246-5733043c847a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:15.573822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730248cb-192d-4547-a246-5733043c847a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:15.588399 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 437/882] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Oct 13 04:10:15 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:10:17.719496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e634cf-df7b-4036-ba28-df2472c3e436 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:17.720036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e634cf-df7b-4036-ba28-df2472c3e436 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:17.720036 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e634cf-df7b-4036-ba28-df2472c3e436 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:17.721423 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 446/883] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:17.726608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:17.727039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:17.727147 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:17.745619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:17.746782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:17.809602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 438/884] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:18.074056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e634cf-df7b-4036-ba28-df2472c3e436 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:18.154968 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:18.171170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e634cf-df7b-4036-ba28-df2472c3e436 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:18.204118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:18.204725 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:18.204998 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:18.205293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] PATH_INFO: `/v3/domains/f8dd8e2736674b72b3d18539e3a1fd87` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:18.215181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8dd8e2736674b72b3d18539e3a1fd87)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:18.216588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c0c1-eb58-49ed-819e-28df233b020c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:18.218148 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 447/885] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Oct 13 04:10:18 2022] GET /identity/v3/domains/f8dd8e2736674b72b3d18539e3a1fd87 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:18.223825 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:18.247757 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:18.318926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa24d-6ab5-46f8-8077-a6c35d6c6fad None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:18.352098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:18.352717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:18.353000 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:18.353318 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:18.354222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:18.355643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f3ace-91c7-4a03-aeea-3056c817f0e1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:18.381472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 439/886] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:10:18 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:10:20.519342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404307ca-772a-4321-85d3-3620ba519381 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:20.519916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404307ca-772a-4321-85d3-3620ba519381 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:20.519916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404307ca-772a-4321-85d3-3620ba519381 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:20.521243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 448/887] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:20.526858 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:20.527252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:20.527410 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:20.546304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:20.547473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:20.611749 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 440/888] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:20.877806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404307ca-772a-4321-85d3-3620ba519381 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:20.979681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404307ca-772a-4321-85d3-3620ba519381 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:21.011451 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:21.012067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:21.012346 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:21.012619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] PATH_INFO: `/v3/domains/f8dd8e2736674b72b3d18539e3a1fd87` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:21.013761 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8dd8e2736674b72b3d18539e3a1fd87)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:21.015181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469f4c2-c868-4c6c-b60f-f65ec8964b5e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:21.016718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 449/889] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Oct 13 04:10:20 2022] GET /identity/v3/domains/f8dd8e2736674b72b3d18539e3a1fd87 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:21.022411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:21.030424 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:21.119925 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92553a5-51d5-4761-865c-fb525ed2628c None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:21.152632 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:21.153189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:21.153466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:21.153734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:21.154369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:21.155786 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a49ab-dd91-4a68-9c6c-d6b9753de747 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:21.175539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 441/890] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:10:21 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:10:23.291740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f05ab-f24f-4ca1-9a54-879875ce89de None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:23.292297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f05ab-f24f-4ca1-9a54-879875ce89de None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:23.292297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f05ab-f24f-4ca1-9a54-879875ce89de None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:23.293637 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 450/891] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:23.298653 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:23.299070 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:23.299197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:23.317360 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:23.318527 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:23.373617 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:23.384529 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 442/892] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:23.651529 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f05ab-f24f-4ca1-9a54-879875ce89de None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:23.667142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:23.750941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f05ab-f24f-4ca1-9a54-879875ce89de None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:23.783448 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:23.784064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:23.784345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:23.784621 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:23.794816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:10:23.799549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:10:23.800672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:10:23.801811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 451/893] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:10:23.806461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:23.901346 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f045-8709-4527-8dfa-bb0b3398ab0e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:23.933970 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:23.934580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:23.934861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:23.935136 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:23.935802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:23.936107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:23.937506 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:23.945475 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 443/894] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:23.951690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:24.019929 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:24.049404 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b578e-13f0-49af-964b-4c3647c225c8 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:24.081548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:24.082164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:24.082444 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:24.082715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] PATH_INFO: `/v3/users/61dd5935202445409d61295298219c16` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:24.096041 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] RBAC: Authorizing `identity:get_user(user_id=61dd5935202445409d61295298219c16)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:24.097495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:24.099101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 452/895] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:10:23 2022] GET /identity/v3/users/61dd5935202445409d61295298219c16 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:24.105187 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:24.158482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:24.202259 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f82c31-3726-43da-8aa0-bc65e044e93b None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:24.233987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:24.234602 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:24.234879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:24.235150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] PATH_INFO: `/v3/projects/ffe83f63d939407a8132675f8584b01f` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:24.236250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] RBAC: Authorizing `identity:get_project(project_id=ffe83f63d939407a8132675f8584b01f)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:24.237707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab73db-d3a0-4240-aca0-85e084d3a16c None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:24.239290 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 444/896] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:10:24 2022] GET /identity/v3/projects/ffe83f63d939407a8132675f8584b01f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:24.245767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:24.340913 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce39f7-e639-445d-bb2c-12f3e5c5f7b9 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:24.368142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:24.374709 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:24.375360 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:24.375642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:24.375916 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] PATH_INFO: `/v3/projects/ffe83f63d939407a8132675f8584b01f/users/61dd5935202445409d61295298219c16/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:24.377791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] RBAC: Authorizing `identity:create_grant(project_id=ffe83f63d939407a8132675f8584b01f, user_id=61dd5935202445409d61295298219c16, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:24.379203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7dfaf-079f-4f1d-b491-4523d53f432c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:24.391447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 453/897] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:10:24 2022] PUT /identity/v3/projects/ffe83f63d939407a8132675f8584b01f/users/61dd5935202445409d61295298219c16/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:10:26.500190 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666bf-1359-4db7-b3ed-37314a4861e8 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:26.500752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666bf-1359-4db7-b3ed-37314a4861e8 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:26.500752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666bf-1359-4db7-b3ed-37314a4861e8 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:26.502086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 445/898] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:10:26.507205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:26.507621 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:26.507732 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:26.525985 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:10:26.527150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:10:26.591937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 454/899] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:10:26.857364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71666bf-1359-4db7-b3ed-37314a4861e8 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:26.955479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71666bf-1359-4db7-b3ed-37314a4861e8 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:26.977308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:26.989358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:26.989980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:26.990257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:26.990529 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.000770 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:10:27.005496 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:10:27.006559 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:10:27.007580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 446/900] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:10:27.012593 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:27.107640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8392975-daaa-4f96-be76-3d0466679a27 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:27.127004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:27.141545 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:27.142149 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:27.142426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:27.142694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.143348 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:27.143649 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:27.145002 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:27.153411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 455/901] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:10:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:27.159275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:27.254664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d740b9c-fea3-42b0-b404-b4ce02d29180 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:27.287220 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:27.287832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:27.288106 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:27.288376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] PATH_INFO: `/v3/users/61dd5935202445409d61295298219c16` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.289490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=61dd5935202445409d61295298219c16)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:27.291486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:27.293008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 447/902] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Oct 13 04:10:27 2022] GET /identity/v3/users/61dd5935202445409d61295298219c16 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:27.298486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:27.394942 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cafa-22d2-407a-9b9e-b7c445004b35 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:27.426082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:27.426672 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:27.426951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:27.427223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.473855 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:27.493112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:27.495076 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:27.587449 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 456/903] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:10:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:10:27.593516 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:27.641999 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:27.690814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b33f2-b928-4fa2-a63f-7f22c0a2f0d2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:27.722191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:27.722807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:27.723087 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:27.723362 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] PATH_INFO: `/v3/projects/ffe83f63d939407a8132675f8584b01f` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.724455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ffe83f63d939407a8132675f8584b01f)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:27.725905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098cb7-1e04-4946-b9ff-99efe56511a9 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:27.727491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 448/904] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Oct 13 04:10:27 2022] GET /identity/v3/projects/ffe83f63d939407a8132675f8584b01f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:27.734261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:10:27.811671 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:27.828979 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a82c-7933-4d8c-8b27-2e61f426d08c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:10:27.861536 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:10:27.862124 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:10:27.862406 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:10:27.862680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:10:27.863392 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=ffe83f63d939407a8132675f8584b01f, user.id=61dd5935202445409d61295298219c16) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:10:27.863701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:10:27.865103 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ffea5-56af-422c-bf19-714de551fea0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:10:27.870686 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 457/905] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:10:27 2022] GET /identity/v3/role_assignments?user.id=61dd5935202445409d61295298219c16&scope.project.id=ffe83f63d939407a8132675f8584b01f&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:10:37.718191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=41 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:10:37.868572 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=27 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:22.807374 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d629c0-253d-48a5-b5b6-8f2b9c25c578 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:22.807989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d629c0-253d-48a5-b5b6-8f2b9c25c578 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:22.807989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d629c0-253d-48a5-b5b6-8f2b9c25c578 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:22.809592 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 449/906] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:22.818712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:22.818712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:22.818712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:22.838612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:22.839901 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:22.925902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 458/907] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:23.247831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d629c0-253d-48a5-b5b6-8f2b9c25c578 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:23.386544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d629c0-253d-48a5-b5b6-8f2b9c25c578 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:23.430712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:23.431421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:23.431767 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:23.432114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:23.444189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:23.446054 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:23.467142 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:23.473826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:23.475177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:23.475177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:23.475177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:23.475177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 450/908] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:11:23.477491 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:23.609613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a56c1-22f9-4cb3-aeec-a9b54dcfeef0 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:23.651645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:23.663397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:23.664052 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:23.664285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:23.664551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:23.665228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:23.665603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:23.667386 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4142d-02ce-4e0f-8378-61adaf83bfba None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:23.685163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 459/909] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:23.688490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:23.766355 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:23.834873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2527e-d7ae-41cc-8a72-a73d1f161df6 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:23.881221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:23.881809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:23.882637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:23.882932 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:23.883622 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:23.885209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add383ca-aeff-4291-a4a0-6b59f9d2dc0d None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:23.915889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 451/910] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Oct 13 04:11:23 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:11:26.434888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee304d-962e-46b6-93c9-566d001352d6 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:26.435490 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee304d-962e-46b6-93c9-566d001352d6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:26.435490 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee304d-962e-46b6-93c9-566d001352d6 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:26.437302 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 460/911] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:11:26.442480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:26.442931 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:26.443018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:26.464071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:26.465319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:26.547239 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 452/912] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:26.853408 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee304d-962e-46b6-93c9-566d001352d6 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:26.990810 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee304d-962e-46b6-93c9-566d001352d6 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.030115 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.030752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.031319 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.031667 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.045156 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:11:27.050837 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:27.051829 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:27.053267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 461/913] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:27.058667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:27.105027 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:27.179528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21446b9-d0a3-493e-9d06-628d8429189f None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.222659 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.223350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.223684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.223994 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.226725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:27.226725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:27.227102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:27.237708 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 453/914] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:27.245012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:27.302288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:27.372610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883229b1-d7fa-45d4-9403-d6943bca5fbb None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.411855 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.412541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.412876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.413746 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.426351 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:27.428006 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:27.448802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:27.450313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:27.451239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:27.451239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:27.451239 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:27.456889 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 462/915] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:27.457031 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:27.573946 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:27.577343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505607-808f-4ad1-8406-71f71cc8b8f2 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.614333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.614951 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.615208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.615481 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.616127 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:27.617114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:27.618428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:27.631260 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 454/916] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:27.636730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:27.744257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8e24-0f43-4090-a513-55546c4fef04 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.745937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:27.781582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.782214 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.782496 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.782770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.790909 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:27.792339 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:11:27.804512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:27.805547 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:27.806549 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 463/917] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:11:27.813429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:27.931570 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f0728-a468-4bf8-8d4d-2809835eb650 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:27.980764 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:27.981529 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:27.981847 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:27.982159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:27.983134 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:27.983525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:27.985376 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.004810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 455/918] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Oct 13 04:11:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:28.010978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:28.133086 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878b33a-8e05-46b2-b311-8bab23b2f693 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:28.168804 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:28.169504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:28.169786 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:28.170007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:28.181255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:28.182932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:28.200102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:28.201328 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:28.202456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:28.202456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:28.202456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:28.207523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:28.207999 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 464/919] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:11:28.229465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:28.343086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79ab1-8f1d-474b-9d60-13e0e9a02ae3 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:28.389457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:28.390125 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:28.390433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:28.390734 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:28.391428 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:28.391768 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:28.393325 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.406466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 456/920] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:28.412376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:28.432630 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:28.532361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329641-5e6e-4e1e-9ef1-a60164d2aa43 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:28.574967 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:28.575605 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:28.575888 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:28.576221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:28.583322 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:28.584934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:11:28.598231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:28.599365 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:28.600256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 465/921] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:28.606141 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:28.702720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:28.727398 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfe175-d96c-4530-a04e-44956d8d2fdb None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:28.763013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:28.763621 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:28.763896 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:28.764237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:28.764926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:28.765266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:28.766696 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac20f0d-1a41-46be-a6ae-de5d3bbe1bb7 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.778968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 457/922] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:28.785257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:28.869410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:28.895805 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a674-3e34-471c-8262-846e5ed70944 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:28.935120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:28.935926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] REQUEST_METHOD: `PUT` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:28.936213 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:28.936486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2684230fec514081920eccfd57e47678/roles/33e48485372649c6a0c1225676e1bea9` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:28.955602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=2684230fec514081920eccfd57e47678, role_id=33e48485372649c6a0c1225676e1bea9)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:28.957939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184121c-eee0-4dc4-8848-b3d423750482 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:28.972694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 466/923] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:11:28 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2684230fec514081920eccfd57e47678/roles/33e48485372649c6a0c1225676e1bea9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:11:31.392780 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527654b-e275-411d-a705-25d801f32e5d None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:31.393330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527654b-e275-411d-a705-25d801f32e5d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:31.393446 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527654b-e275-411d-a705-25d801f32e5d None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:31.394689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 458/924] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:31.400597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:31.401044 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:31.401212 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:31.420135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:31.421347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:31.496267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 467/925] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:31.764067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527654b-e275-411d-a705-25d801f32e5d None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:31.870955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527654b-e275-411d-a705-25d801f32e5d None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:31.911268 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:31.911898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:31.912171 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:31.912437 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:31.919157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:31.923214 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:11:31.928176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:31.929945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:31.930810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 459/926] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Oct 13 04:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:31.937300 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.000264 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:32.050840 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a87b2-42ec-403c-a32c-d6cfc618aae3 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.086833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.087472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.087757 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.088032 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:32.088744 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] RBAC: Adding query filter params (name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:32.089181 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:32.090606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:32.101166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 468/927] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Oct 13 04:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:32.107205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.227077 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c57a40-31a1-43eb-b64a-825ca6c460d0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.263625 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.264178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.264455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.264726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:32.275090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:32.276511 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:32.294683 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:32.295727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:32.296633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:32.296633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:32.296633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:32.296633 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 460/928] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:32.302450 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.411166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1c01-b143-4dfd-beb2-1f036609108a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.428269 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:32.448327 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.448963 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.449277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.449551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:32.450199 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:32.450504 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:32.451957 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:32.465298 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 469/929] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:32.471077 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.523845 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:32.577488 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073baea-c4c1-4056-b75b-69907a9894a1 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.616614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.617328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.617610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.617886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:32.626396 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:32.627836 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:11:32.639619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:32.641058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:32.642288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 461/930] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:32.646564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.759648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ded50-1a5b-41fe-9d5e-3437782a8fd3 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.796125 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.796747 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.797035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.797338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:32.798071 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:32.798376 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:32.799806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:32.817447 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 470/931] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Oct 13 04:11:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:32.823895 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:32.931285 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1bf49-b9d9-448b-8e4f-d250f6940753 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:32.943815 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:32.979700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:32.980553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:32.980910 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:32.981232 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:33.064727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:33.066460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:33.171226 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 462/932] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:11:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 04:11:33.177377 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:33.215596 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:33.289139 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c171d5-8c63-48c0-a10a-94f1edc0dc45 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:33.328575 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:33.329268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:33.329554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:33.329825 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:33.340754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:33.342466 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:33.357846 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:33.358823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:33.359703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:33.359703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:33.359703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:33.359703 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 471/933] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:33.366473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:33.378409 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:33.469277 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad643b25-9653-463a-8e84-3877edf344e6 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:33.505893 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:33.507280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:33.507632 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:33.507993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:33.508697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:33.509013 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:33.510667 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:33.523955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 463/934] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:33.529463 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:33.624123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:33.639845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75107-dfbf-416d-9746-456e7d279e22 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:33.678939 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:33.679754 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:33.680072 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:33.680354 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:33.688469 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:33.690137 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:11:33.705172 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:33.706259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:33.707352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 472/935] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 04:11:33.712842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:33.785369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:33.817983 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c09a5-3739-4d48-8b40-ea8d479be406 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:33.854417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:33.855062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:33.855340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:33.855702 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:33.856379 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:33.856700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:33.858462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849a3e-7391-43ac-887a-1886a76d5327 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:33.872521 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 464/936] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:33.879409 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:33.995457 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0bd8d-a4f2-4e14-8823-3172b57bf29d None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:34.033785 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:34.034385 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:34.034668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:34.034940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:34.035719 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] RBAC: Adding query filter params (role.id=33e48485372649c6a0c1225676e1bea9, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=2684230fec514081920eccfd57e47678) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:34.035977 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:34.037430 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089b4e0-f52b-4216-a951-4ff3632b71d1 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:34.043675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 473/937] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:11:33 2022] GET /identity/v3/role_assignments?user.id=2684230fec514081920eccfd57e47678&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=33e48485372649c6a0c1225676e1bea9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:36.280541 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2a79-40a3-4453-bba7-3d9bf4b4b0f4 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:36.281165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2a79-40a3-4453-bba7-3d9bf4b4b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:36.281165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2a79-40a3-4453-bba7-3d9bf4b4b0f4 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:36.282436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 465/938] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:36.288035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:36.288511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:36.288650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:36.309570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:36.310867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:36.314116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:36.387461 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 474/939] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:36.656400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2a79-40a3-4453-bba7-3d9bf4b4b0f4 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:36.764913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2a79-40a3-4453-bba7-3d9bf4b4b0f4 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:36.803652 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:36.811214 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:36.812080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:36.812390 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:36.812794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:36.824551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:11:36.829447 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:36.830372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:36.831257 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 466/940] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:36.837185 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:36.945585 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870fe9b-8780-4a13-a1bd-9716f685ee46 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:36.987313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:36.987969 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:36.988342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:36.988611 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:36.989312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:36.989618 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:36.991676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.000714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 475/941] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:37.007519 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:37.116364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c97bc-159a-463f-912e-fadd28618141 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:37.155441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:37.156164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:37.156477 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:37.156816 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:37.168299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:37.169807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:37.186660 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:37.187807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:37.188839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:37.188839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:37.188839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:37.188839 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 467/942] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:37.193789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:37.197318 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:37.301432 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2558-f1e5-41f7-a7dc-2e9620563eed None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:37.340569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab159-be64-464b-b668-891e15255449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:37.341324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab159-be64-464b-b668-891e15255449 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:37.341602 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab159-be64-464b-b668-891e15255449 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:37.341870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab159-be64-464b-b668-891e15255449 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:37.342517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab159-be64-464b-b668-891e15255449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:37.342819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab159-be64-464b-b668-891e15255449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:37.344187 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab159-be64-464b-b668-891e15255449 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.358179 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 476/943] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:37.363997 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:37.413458 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:37.476752 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c9d26-ec2c-4896-9b4d-a2c5499d3479 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:37.513434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:37.514068 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:37.514390 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:37.514666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:37.522801 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:37.524329 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:11:37.535952 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:37.537386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:37.539025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 468/944] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:37.543656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab159-be64-464b-b668-891e15255449 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:37.609896 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:37.652849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab159-be64-464b-b668-891e15255449 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:37.690600 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:37.691259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:37.691540 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:37.691812 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:37.692554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:37.692861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:37.695331 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.713814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 477/945] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:37.719861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:37.830005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5741842-06d3-4ce2-8c08-d55ef959c2ca None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:37.833028 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:37.869883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:37.870515 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:37.870793 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:37.871063 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:37.881876 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:37.883443 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:37.898228 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:37.899604 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:37.900503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:37.900503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:37.900503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:37.900503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 469/946] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:37.905160 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:38.021169 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a62a4-eaf9-435f-9f9e-850ac61f9970 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:38.043834 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:38.061253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:38.061859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:38.062173 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:38.062456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:38.063163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:38.063475 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:38.064949 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:38.079279 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 478/947] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:38.085324 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:38.193217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b08a0-05c5-46bc-af76-4808f7d1ec89 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:38.230168 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:38.231012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:38.231274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:38.231617 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:38.240036 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:38.242078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:11:38.253554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:38.254761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:38.255930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:38.257606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 470/948] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:38.263502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:38.375488 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96909-f606-4b45-aef1-e471e5bee010 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:38.411417 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:38.412093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:38.412440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:38.412793 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:38.413572 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:38.413908 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:38.415625 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166be7c-1379-4679-942a-996ac15d5295 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:38.427958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 479/949] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:38.436487 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:38.455074 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:38.556333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825df8-eaf0-4462-80ae-f754037ac288 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:38.595212 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:38.595868 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:38.596143 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:38.596411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] PATH_INFO: `/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2684230fec514081920eccfd57e47678/roles/b14e21de15a34f23963248e91563ee32` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:38.598289 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f68f0139704babad0653d3c0dcd153, user_id=2684230fec514081920eccfd57e47678, role_id=b14e21de15a34f23963248e91563ee32)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:38.599720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ae55-454e-4167-ac56-bd84e16cbe10 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:38.615185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 471/950] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Oct 13 04:11:38 2022] PUT /identity/v3/projects/e4f68f0139704babad0653d3c0dcd153/users/2684230fec514081920eccfd57e47678/roles/b14e21de15a34f23963248e91563ee32 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:11:40.968000 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405498ea-30a9-4428-9b50-a2b174405623 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:40.968708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405498ea-30a9-4428-9b50-a2b174405623 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:40.968708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405498ea-30a9-4428-9b50-a2b174405623 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:40.970194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 480/951] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 04:11:40.978264 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:40.979130 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:40.979361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:41.001283 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:41.002847 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:41.079193 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 472/952] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:11:41.348227 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405498ea-30a9-4428-9b50-a2b174405623 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:41.399016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:41.467622 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405498ea-30a9-4428-9b50-a2b174405623 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:41.503485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:41.504120 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:41.504400 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:41.504676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:41.517326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 04:11:41.522650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:41.523716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:41.524563 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 481/953] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Oct 13 04:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:41.529816 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:41.533162 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:41.640765 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30784f-58ff-4cf8-b4fb-14e8e9e6e1bc None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:41.675750 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:41.676467 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:41.676814 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:41.677180 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:41.677890 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:41.678700 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:41.680094 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:41.689384 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 473/954] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Oct 13 04:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:41.696130 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:41.797595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:41.800819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f999-8e2b-42fc-9d15-ecfa680ec3ac None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:41.836291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:41.836941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:41.837250 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:41.837521 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:41.848659 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:41.850680 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:41.866713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:41.867937 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:41.869015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:41.869015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:41.869015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:41.869015 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 482/955] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:41.873831 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:41.942903 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:41.994154 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d433-e97e-482b-b2c6-7c3f62359084 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.029265 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.029873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.030151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.030420 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] PATH_INFO: `/v3/domains` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.031065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:42.031363 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.032723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.044993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 474/956] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:42.050648 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:42.153296 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380644a-df02-42ca-9cec-356cb6da530c None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.187739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.188694 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.189211 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.189482 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.197282 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.198657 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 04:11:42.210295 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:42.211405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:42.212378 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 483/957] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:42.218875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:42.316480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a65a1-6598-4679-8ccd-570a460ad20a None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.341392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:42.351003 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.351603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.351880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.352149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] PATH_INFO: `/v3/users` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.352862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:42.353189 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.354879 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.371113 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 475/958] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:42.376836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:42.391887 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:42.473280 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7e0c-029d-4ddb-84d1-aba008dce498 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.505410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.506001 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.506811 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.507082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.570407 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.571823 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.584456 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:42.665783 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 484/959] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 04:11:42.671462 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:42.767553 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036ea21-ebe4-4bb5-bf1d-9f9b0496f002 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.800097 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.800707 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.800984 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.801287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.811478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.812898 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 04:11:42.827411 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:42.828508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 04:11:42.829778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 04:11:42.829778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 04:11:42.829778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:42.829778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 476/960] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:42.834045 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:42.929018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125684-ae09-4e37-8b41-669caaa0b74e None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:42.941789 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:42.969641 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:42.970253 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:42.970538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:42.970806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:42.971443 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:42.971765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:42.973232 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:42.985248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 485/961] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:42.991040 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:43.025159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:43.087400 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba479d-66ce-4e1f-bff7-0377598d4fe0 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:43.119647 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:43.120258 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:43.120533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:43.120802 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:43.127149 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:43.128562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 04:11:43.139304 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:43.140217 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: ERROR keystone.server.flask.application Oct 13 04:11:43.141222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 477/962] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Oct 13 04:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:43.146135 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:43.241688 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477fb6-e9d5-4a2a-af84-5bb77f23bb2a None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:43.273758 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:43.274345 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:43.274629 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:43.274890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:43.275606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:43.275861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:43.277288 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81444f-7d64-4b04-a873-d7580ebd4a6b None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:43.288509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 486/963] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Oct 13 04:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 04:11:43.294148 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:43.386295 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:43.392333 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b8193-3661-4490-8580-fcbd22732c64 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:43.424706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:43.425330 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:43.425610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:43.425886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:43.426606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] RBAC: Adding query filter params (role.id=b14e21de15a34f23963248e91563ee32, scope.project.id=e4f68f0139704babad0653d3c0dcd153, user.id=2684230fec514081920eccfd57e47678) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:43.426921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:43.428372 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e317-d47a-450d-9d48-7e981dbd5793 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:43.433964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 478/964] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Oct 13 04:11:43 2022] GET /identity/v3/role_assignments?user.id=2684230fec514081920eccfd57e47678&scope.project.id=e4f68f0139704babad0653d3c0dcd153&role.id=b14e21de15a34f23963248e91563ee32 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:45.526840 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04606-a7bf-4724-a5bc-54ff22091970 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:45.527361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04606-a7bf-4724-a5bc-54ff22091970 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:45.527361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04606-a7bf-4724-a5bc-54ff22091970 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:45.528715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 487/965] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:45.534067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:45.534484 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:45.534619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:45.552227 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:45.553435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:45.617916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 479/966] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:45.884809 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04606-a7bf-4724-a5bc-54ff22091970 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:45.915752 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:45.991353 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04606-a7bf-4724-a5bc-54ff22091970 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:46.026564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:46.027191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:46.027467 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:46.027737 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:46.028317 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:46.029774 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:46.038912 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:46.040123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:46.041176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 488/967] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:11:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:46.046163 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:46.132171 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:46.141905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0555d60-b323-46aa-bd92-1bfbb4f0be97 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:46.174058 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:46.174682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:46.174957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:46.175225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:46.175846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:46.176146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:46.177523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c789d-342a-478c-a687-fc46ad9f44a1 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:46.182736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 480/968] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Oct 13 04:11:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:46.188402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:46.279552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:46.285792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313f92-c328-48cf-911b-12b0f8b505e0 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:46.317043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:46.317668 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:46.317948 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:46.318220 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] PATH_INFO: `/v3/services` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:46.319335 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:46.319636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:46.320987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b45b-5bdb-4c3f-9bb8-15b1749f6218 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:46.325567 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 489/969] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Oct 13 04:11:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:48.462098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf34f-7e57-43c7-b892-f6e707bd277f None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:48.462614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf34f-7e57-43c7-b892-f6e707bd277f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:48.462614 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf34f-7e57-43c7-b892-f6e707bd277f None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:48.463979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 481/970] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:48.469275 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e2db-76f8-4646-ab57-1351bee2d4b4 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:48.469691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e2db-76f8-4646-ab57-1351bee2d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:48.469815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e2db-76f8-4646-ab57-1351bee2d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:48.488304 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f516e2db-76f8-4646-ab57-1351bee2d4b4 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:48.489532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f516e2db-76f8-4646-ab57-1351bee2d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:48.553662 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 490/971] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 04:11:48.813849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf34f-7e57-43c7-b892-f6e707bd277f None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:48.912009 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf34f-7e57-43c7-b892-f6e707bd277f None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:48.947001 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:48.947636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:48.947957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:48.948270 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:48.949066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:48.950643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838a205-3a4c-4e00-9bf1-3fbb10552d49 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:48.967340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 482/972] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Oct 13 04:11:48 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:11:51.094281 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1e6d-992e-416a-bf0a-dd70ab8b3770 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:51.094819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1e6d-992e-416a-bf0a-dd70ab8b3770 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:51.094819 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c1e6d-992e-416a-bf0a-dd70ab8b3770 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:51.096163 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 491/973] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:51.101704 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:51.102077 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:51.102252 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:51.120779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:51.121974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:51.130878 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:51.193518 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 483/974] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:51.460535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c1e6d-992e-416a-bf0a-dd70ab8b3770 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:51.548704 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:51.559270 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c1e6d-992e-416a-bf0a-dd70ab8b3770 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:51.591677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:51.592306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:51.592569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:51.592843 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] PATH_INFO: `/v3/services/placement` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:51.593453 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:51.594814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:51.604075 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:51.605238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:51.606228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 492/975] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:11:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:51.611132 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:51.704657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74a5fe-818f-4629-8db0-47ecf0c6c3de None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:51.736889 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:51.737444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:51.737720 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:51.737987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:51.738608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:51.738906 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:51.740407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:51.745253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 484/976] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Oct 13 04:11:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:51.750919 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:51.846383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4740111-5ed3-4ba9-9a14-f97715550fac None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:51.878476 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:51.879060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:51.879340 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:51.879613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:51.880301 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] RBAC: Adding query filter params (interface=public, service_id=84c696bfb8cb4d23afdc1b908ceed2e5, region_id=RegionOne) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:51.880612 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:51.882534 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be3fe-337e-4a79-9988-e59991897185 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:51.887284 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 493/977] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Oct 13 04:11:51 2022] GET /identity/v3/endpoints?service_id=84c696bfb8cb4d23afdc1b908ceed2e5&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:51.892964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:51.897101 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:51.992782 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235477a-6b88-4259-83df-28b82cf44e92 None admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:52.025566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:52.026165 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:52.026441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:52.026713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:52.027311 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:52.028663 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d869a-461f-4048-b407-5aac31f5d63e None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:52.035336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 485/978] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Oct 13 04:11:51 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:11:54.135056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a7c2-6238-4f32-818f-785f6b6bf3c8 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:54.135636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a7c2-6238-4f32-818f-785f6b6bf3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:54.135636 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a7c2-6238-4f32-818f-785f6b6bf3c8 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:54.136919 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 494/979] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:11:54.142015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:54.142460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:54.142568 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:54.160624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:11:54.162520 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:11:54.222979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:54.229415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 486/980] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:11:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 04:11:54.494849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a7c2-6238-4f32-818f-785f6b6bf3c8 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:54.514508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:54.594656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a7c2-6238-4f32-818f-785f6b6bf3c8 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:54.627502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:54.628121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:54.628403 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:54.628683 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:54.629300 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:54.630677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 04:11:54.639228 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 04:11:54.640494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application with Lock( Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self._enter() Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application return self.creator() Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application created_value = creator( Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: ERROR keystone.server.flask.application Oct 13 04:11:54.641713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 495/981] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Oct 13 04:11:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 04:11:54.646121 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:54.740610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e33994-6131-45e5-af1c-b37f98c6e416 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:54.772538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:54.773069 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:54.773375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:54.773646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] PATH_INFO: `/v3/services` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:54.774266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:11:54.774566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:54.775947 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6f486-bd9b-4bb7-9ef3-95737aeff144 None admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:54.780830 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 487/982] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Oct 13 04:11:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:11:54.786312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:11:54.865820 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:11:54.883121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8608e-0fb7-4b2e-9b3e-0abbd1e5d559 None admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:11:54.916003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:11:54.916588 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:11:54.916866 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:11:54.917157 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:11:54.917831 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:11:54.919176 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb21a2-97ab-4d66-a183-a28bc3c889e5 None admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:11:54.937294 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 496/983] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:11:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:12:04.778095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=69 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:12:04.932986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:12:58.062979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5bc6-7240-43e8-b7e1-8a2118b17731 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:12:58.063468 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5bc6-7240-43e8-b7e1-8a2118b17731 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:12:58.063548 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5bc6-7240-43e8-b7e1-8a2118b17731 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:12:58.065015 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 488/984] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:12:58.070934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6856-0e15-4f6b-a631-d712d93af466 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:12:58.071337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6856-0e15-4f6b-a631-d712d93af466 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:12:58.071542 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6856-0e15-4f6b-a631-d712d93af466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:12:58.163642 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-1ccc6856-0e15-4f6b-a631-d712d93af466 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:12:58.165234 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1ccc6856-0e15-4f6b-a631-d712d93af466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:12:58.295153 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 497/985] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:12:58.595837 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:12:58.596373 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:12:58.597525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:12:58.599415 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 489/986] 10.222.0.13 () {54 vars in 964 bytes} [Thu Oct 13 04:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:12:58.606645 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13598a9a-813a-462d-bf69-f3945eccf31a None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:12:58.607205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13598a9a-813a-462d-bf69-f3945eccf31a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:12:58.607592 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13598a9a-813a-462d-bf69-f3945eccf31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:12:58.705226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-13598a9a-813a-462d-bf69-f3945eccf31a None None] MFA Rules not processed for user `32d83c87e17740eb943517d7f5503817`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:12:58.707010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-13598a9a-813a-462d-bf69-f3945eccf31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:12:58.732186 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:12:58.800361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 498/987] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Oct 13 04:12:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:12:58.809312 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:12:58.811138 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:12:58.921778 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64c534-bfaf-432c-980e-b0783007db9a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:12:59.000688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:12:59.001364 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:12:59.001713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:12:59.002051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:12:59.003826 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:12:59.061104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:12:59.127502 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:12:59.129723 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cef81-5dda-4b3c-ae59-21cd0e49fdd5 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:12:59.166937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 490/988] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:01.646506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:01.647033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:01.647157 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:01.648409 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 499/989] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:01.653842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04056ef-084a-4f90-ae09-d772b3a06f57 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:01.654242 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04056ef-084a-4f90-ae09-d772b3a06f57 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:01.654343 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04056ef-084a-4f90-ae09-d772b3a06f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:01.726274 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d04056ef-084a-4f90-ae09-d772b3a06f57 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:01.727456 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d04056ef-084a-4f90-ae09-d772b3a06f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:01.822337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 491/990] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:13:02.104087 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:02.105681 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:02.208780 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4260d4-0e99-4916-bd32-60e7ecf29bb2 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:02.277587 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:02.279651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:02.280247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:02.280532 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:02.281004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:02.282975 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:02.389735 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:02.391095 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6806d2-bcd5-4d31-a1d5-85890e2a74c1 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:02.409037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 500/991] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:04.829216 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:04.829769 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:04.829769 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:04.831624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 492/992] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:04.836658 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc6ee-9a3f-4b75-a221-ec73f2974429 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:04.837035 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc6ee-9a3f-4b75-a221-ec73f2974429 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:04.837234 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc6ee-9a3f-4b75-a221-ec73f2974429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:04.902296 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-badcc6ee-9a3f-4b75-a221-ec73f2974429 None None] MFA Rules not processed for user `aeefeb7090314670ac1c4ff3aa09fb73`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:04.903480 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-badcc6ee-9a3f-4b75-a221-ec73f2974429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:04.953785 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:04.997948 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 501/993] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:05.278939 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:05.280486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:05.290231 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:05.382444 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3939503-822c-48d1-a3ef-7d6e683d16dd None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:05.453626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:05.454224 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:05.454503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:05.454774 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:05.456886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:05.517776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:05.562908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:05.564266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4293f5-bc1b-4050-821b-ee7c749d88e9 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:05.582794 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 493/994] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:08.253390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:08.253978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:08.253978 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:08.255280 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 502/995] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:08.260759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd6df-b57b-48d4-9a73-c5924244c92a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:08.261205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd6df-b57b-48d4-9a73-c5924244c92a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:08.261336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fd6df-b57b-48d4-9a73-c5924244c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:08.327171 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-868fd6df-b57b-48d4-9a73-c5924244c92a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:08.328375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-868fd6df-b57b-48d4-9a73-c5924244c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:08.422459 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 494/996] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:08.706440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:08.707984 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:08.811338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9f95-e1be-49d2-953b-2b732327fa41 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:08.883341 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:08.883940 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:08.884221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:08.884492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:08.886100 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:08.892763 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:08.994022 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:08.995370 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06daf77-08cc-439b-9f2f-8b21c656ef95 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:09.013206 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 503/997] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:11.773533 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:11.774096 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:11.774096 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:11.775417 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 495/998] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:11.780734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547575-56c9-4c77-be1e-9bdff477e45b None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:11.781249 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547575-56c9-4c77-be1e-9bdff477e45b None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:11.781364 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547575-56c9-4c77-be1e-9bdff477e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:11.847613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ac547575-56c9-4c77-be1e-9bdff477e45b None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:11.849121 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ac547575-56c9-4c77-be1e-9bdff477e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:11.912233 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:11.955436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 504/999] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:12.243937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:12.245587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:12.265797 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:12.350170 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a4ba-fc4c-4465-8277-15755a88a99a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:12.422977 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:12.423566 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:12.423846 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:12.424116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:12.426235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:12.497048 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:12.535640 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:12.537156 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3e1f3-6bf9-477f-b418-0cebdbec9b77 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:12.555392 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 496/1000] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:14.775338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:14.775903 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:14.775903 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:14.777562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 505/1001] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:14.782721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e584f9-0244-447a-b461-f96ec6f0320d None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:14.783117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e584f9-0244-447a-b461-f96ec6f0320d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:14.783271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e584f9-0244-447a-b461-f96ec6f0320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:14.849685 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b6e584f9-0244-447a-b461-f96ec6f0320d None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:14.851078 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b6e584f9-0244-447a-b461-f96ec6f0320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:14.956739 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 497/1002] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:15.237357 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:15.238911 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:15.345306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e074f-b954-41bc-8fbe-e844c7371441 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:15.420079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:15.420690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:15.420970 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:15.421279 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:15.422867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:15.439310 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:15.531517 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:15.532891 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09874-db69-4a48-a04a-f804347df4d7 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:15.550921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 506/1003] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:17.755346 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:17.755836 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:17.755836 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:17.757205 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 498/1004] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:17.762592 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21802-d750-41ef-9678-48de358ca199 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:17.763007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21802-d750-41ef-9678-48de358ca199 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:17.763146 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21802-d750-41ef-9678-48de358ca199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:17.828379 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e6a21802-d750-41ef-9678-48de358ca199 None None] MFA Rules not processed for user `aeefeb7090314670ac1c4ff3aa09fb73`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:17.829635 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e6a21802-d750-41ef-9678-48de358ca199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:17.896101 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:17.927742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 507/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:18.217083 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:18.218666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:18.252075 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:18.327124 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152133a6-9838-4bc4-8cd5-4d0bc43a3984 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:18.400422 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:18.400948 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:18.401255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:18.401530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:18.403114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:18.479432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:18.512645 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:18.514114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13bb7-421f-407b-ae28-24c1eada4dd8 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:18.531960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 499/1006] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:20.895856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:20.896389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:20.896389 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:20.897790 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 508/1007] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:20.902836 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ac91-f4f9-4bf6-9eaf-1a523286f5ef None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:20.903262 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ac91-f4f9-4bf6-9eaf-1a523286f5ef None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:20.903366 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ac91-f4f9-4bf6-9eaf-1a523286f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:20.968289 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-f363ac91-f4f9-4bf6-9eaf-1a523286f5ef None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:20.969498 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f363ac91-f4f9-4bf6-9eaf-1a523286f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:21.064360 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 500/1008] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:21.349878 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:21.351435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:21.454594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e9f7-7dd0-4d42-bdf0-8945ed18ce81 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:21.527188 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:21.527787 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:21.528065 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:21.528337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:21.529962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:21.556278 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:21.636815 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:21.638218 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677c499-965a-4deb-a1de-616c4b7737e8 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:21.655690 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 509/1009] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:23.807433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:23.807972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:23.807972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:23.809361 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 501/1010] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:23.814988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518fc5-88ec-4ed1-a55e-19aa14ae34ab None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:23.815369 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518fc5-88ec-4ed1-a55e-19aa14ae34ab None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:23.815534 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518fc5-88ec-4ed1-a55e-19aa14ae34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:23.880429 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-72518fc5-88ec-4ed1-a55e-19aa14ae34ab None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:23.881651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-72518fc5-88ec-4ed1-a55e-19aa14ae34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:23.954042 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:23.976589 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 510/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:24.259457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:24.260980 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:24.301243 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:24.364754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3405da-888d-456e-91c1-2b918f4229f1 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:24.435882 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:24.436480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:24.436756 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:24.437026 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:24.438654 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:24.520264 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:24.548175 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:24.550261 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73da214-d82e-4d21-bbbb-0589d335160d service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:24.567790 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 502/1012] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:27.068534 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ef46-ba58-4209-862d-484990f96098 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:27.069150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ef46-ba58-4209-862d-484990f96098 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:27.069150 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ef46-ba58-4209-862d-484990f96098 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:27.070449 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 511/1013] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:27.075829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223fe8-2815-4575-a82b-9ee2e5e27982 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:27.076249 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223fe8-2815-4575-a82b-9ee2e5e27982 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:27.076358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223fe8-2815-4575-a82b-9ee2e5e27982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:27.141586 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-03223fe8-2815-4575-a82b-9ee2e5e27982 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:27.143263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-03223fe8-2815-4575-a82b-9ee2e5e27982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:27.238612 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 503/1014] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:27.518070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ef46-ba58-4209-862d-484990f96098 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:27.519616 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1302ef46-ba58-4209-862d-484990f96098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:27.620722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ef46-ba58-4209-862d-484990f96098 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:27.692191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:27.692782 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:27.693053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:27.693346 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:27.694902 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:27.729069 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:27.801033 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:27.802473 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b1ac-aa45-4934-8d9e-8ca7211d6dec service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:27.820244 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 512/1015] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:31.831534 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:31.832095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:31.832095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:31.833456 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 504/1016] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:31.838734 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f401a-c9fa-4c07-9867-0bf0d735c80a None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:31.839125 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f401a-c9fa-4c07-9867-0bf0d735c80a None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:31.839289 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f401a-c9fa-4c07-9867-0bf0d735c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:31.905485 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-933f401a-c9fa-4c07-9867-0bf0d735c80a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:31.906573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-933f401a-c9fa-4c07-9867-0bf0d735c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:31.991802 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:32.004073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 513/1017] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:32.292368 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:32.293947 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:32.342931 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:32.399082 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eab6c-edfb-4fd5-887e-68c0a1704616 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:32.472739 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:32.473574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:32.473697 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:32.473899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:32.475473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:32.567222 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:32.584427 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:32.585894 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126993f3-10a6-4c52-99ca-294b6ebd1635 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:32.604664 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 505/1018] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:35.403364 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:35.403772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:35.403865 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:35.405356 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 514/1019] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:35.410619 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79745-c514-4e48-ba47-202596a5bee3 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:35.411069 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79745-c514-4e48-ba47-202596a5bee3 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:35.411179 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79745-c514-4e48-ba47-202596a5bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:35.476725 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-98e79745-c514-4e48-ba47-202596a5bee3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:35.477882 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-98e79745-c514-4e48-ba47-202596a5bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:35.574592 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 506/1020] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:35.852821 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:35.854670 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:35.966333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ccd7-4f31-4e4a-ace9-5ea4b81707aa None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:36.044363 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:36.044971 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:36.045285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:36.045559 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:36.047149 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:36.091336 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:36.160116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:36.161531 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d5e75-166d-4178-a9e3-da652d21c370 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:36.180803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 515/1021] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:40.292771 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:40.293293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:40.293387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:40.294684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 507/1022] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:40.300189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95d44-5443-47a2-8874-efac585bd2f9 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:40.300591 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95d44-5443-47a2-8874-efac585bd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:40.300776 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95d44-5443-47a2-8874-efac585bd2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:40.369650 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-e5d95d44-5443-47a2-8874-efac585bd2f9 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:40.370890 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e5d95d44-5443-47a2-8874-efac585bd2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:40.468651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:40.473696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 516/1023] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:13:40.757514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:40.759191 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:40.816150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:40.861684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ab854-cb7f-4fcf-a0f7-5305a6c32c35 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:40.932718 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:40.933340 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:40.933621 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:40.933890 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:40.935465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:41.040169 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:41.044402 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:41.045862 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b40d-5ac8-40e9-ad82-8926bbc3dfb5 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:41.063429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 508/1024] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:45.985168 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94ce5f-eff3-4fbe-b4a5-af4eef9c882e None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:45.986162 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94ce5f-eff3-4fbe-b4a5-af4eef9c882e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:45.986256 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94ce5f-eff3-4fbe-b4a5-af4eef9c882e None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:45.987869 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 517/1025] 10.222.0.13 () {54 vars in 921 bytes} [Thu Oct 13 04:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:45.993042 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d20ba-60d9-4a01-a26d-dd3ac9625a6e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:45.993504 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d20ba-60d9-4a01-a26d-dd3ac9625a6e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:45.993634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d20ba-60d9-4a01-a26d-dd3ac9625a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:46.101465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-aa7d20ba-60d9-4a01-a26d-dd3ac9625a6e None None] MFA Rules not processed for user `2684230fec514081920eccfd57e47678`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:46.102785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-aa7d20ba-60d9-4a01-a26d-dd3ac9625a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:46.255916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 509/1026] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Oct 13 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:50.294003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10953e4-fb31-4275-a160-a7fc9e1f5b35 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:50.294557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10953e4-fb31-4275-a160-a7fc9e1f5b35 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:50.294557 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10953e4-fb31-4275-a160-a7fc9e1f5b35 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:50.296119 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 518/1027] 10.222.0.13 () {54 vars in 921 bytes} [Thu Oct 13 04:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:50.301743 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2519e-fecf-49b7-9062-f29c522dbdd6 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:50.302192 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2519e-fecf-49b7-9062-f29c522dbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:50.302271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2519e-fecf-49b7-9062-f29c522dbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:50.362688 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:50.386066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-0cd2519e-fecf-49b7-9062-f29c522dbdd6 None None] MFA Rules not processed for user `2684230fec514081920eccfd57e47678`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:50.387256 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-0cd2519e-fecf-49b7-9062-f29c522dbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:50.497026 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 510/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Oct 13 04:13:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:52.080598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9400c-2615-4009-8960-4c240a228963 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:52.081155 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9400c-2615-4009-8960-4c240a228963 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:52.081305 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9400c-2615-4009-8960-4c240a228963 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:52.082710 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 519/1029] 10.222.0.13 () {54 vars in 921 bytes} [Thu Oct 13 04:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:52.087766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69808-e34e-4c7d-9311-1775e8fe5eac None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:52.088197 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69808-e34e-4c7d-9311-1775e8fe5eac None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:52.088436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69808-e34e-4c7d-9311-1775e8fe5eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:52.164033 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-e3d69808-e34e-4c7d-9311-1775e8fe5eac None None] MFA Rules not processed for user `2684230fec514081920eccfd57e47678`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:52.165237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e3d69808-e34e-4c7d-9311-1775e8fe5eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:52.206927 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:52.279466 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 511/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Oct 13 04:13:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:55.736986 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3418-0948-4d71-925b-54f1b361cf75 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:55.737570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3418-0948-4d71-925b-54f1b361cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:55.737570 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3418-0948-4d71-925b-54f1b361cf75 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:55.739116 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 520/1031] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:55.744539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfaa-1803-437f-b2fe-574462d41806 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:55.744985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfaa-1803-437f-b2fe-574462d41806 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:55.745099 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfaa-1803-437f-b2fe-574462d41806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:55.818745 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c211dfaa-1803-437f-b2fe-574462d41806 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:55.819926 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c211dfaa-1803-437f-b2fe-574462d41806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:55.925108 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 512/1032] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:56.225411 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:56.225695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:56.225966 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:56.227713 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 521/1033] 10.222.0.13 () {54 vars in 961 bytes} [Thu Oct 13 04:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:56.234680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f462c-47fc-48e7-a2e1-30291403f657 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:56.235940 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f462c-47fc-48e7-a2e1-30291403f657 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:56.236503 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f462c-47fc-48e7-a2e1-30291403f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:56.257809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:56.331391 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-9e4f462c-47fc-48e7-a2e1-30291403f657 None None] MFA Rules not processed for user `a583664454f04a79a0f43a418a9f1778`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:56.332636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-9e4f462c-47fc-48e7-a2e1-30291403f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:56.455283 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 513/1034] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Oct 13 04:13:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:13:56.463142 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:56.464632 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:56.617506 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6579ca5-df4b-4668-b0b3-3ba63a0ef263 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:13:56.694740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:56.738796 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:13:56.739414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:56.739665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:56.739868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:56.741464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:56.838514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:13:56.840133 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c35d70-ea88-4d7f-a736-c581384e2b5d service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:13:56.861483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 522/1035] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:13:59.229287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:59.229810 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:59.229892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:59.231172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 514/1036] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:13:59.237076 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2862-5898-4130-a53d-6d430965cc58 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:13:59.237511 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2862-5898-4130-a53d-6d430965cc58 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:13:59.237701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2862-5898-4130-a53d-6d430965cc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:13:59.343537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-8efe2862-5898-4130-a53d-6d430965cc58 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:13:59.345268 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-8efe2862-5898-4130-a53d-6d430965cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:59.387069 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:59.454162 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 523/1037] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:13:59.751022 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:13:59.752613 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:13:59.838491 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:13:59.960829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440683bb-2fa7-41bc-a447-5f2722e6b872 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:00.093758 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:00.094890 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:00.095164 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:00.095433 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:00.097017 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:00.122482 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:00.192012 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:00.193643 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b172-8f63-405b-a2d8-6664757423c8 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:00.212272 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 515/1038] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:02.700285 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7f2f8-6b06-4803-822b-643ef8562484 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:02.700814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7f2f8-6b06-4803-822b-643ef8562484 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:02.700814 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7f2f8-6b06-4803-822b-643ef8562484 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:02.702209 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 524/1039] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:02.708102 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc038-c7cd-49ff-97ba-9c264fd16d08 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:02.708880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc038-c7cd-49ff-97ba-9c264fd16d08 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:02.709177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc038-c7cd-49ff-97ba-9c264fd16d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:02.777183 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-335dc038-c7cd-49ff-97ba-9c264fd16d08 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:02.778386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-335dc038-c7cd-49ff-97ba-9c264fd16d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:02.880067 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:02.891059 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 516/1040] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:03.174508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:03.174941 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:03.175344 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:03.176770 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 525/1041] 10.222.0.13 () {54 vars in 961 bytes} [Thu Oct 13 04:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:03.181978 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3085f2-c42d-4d6c-a074-c20fa299b92b None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:03.182263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3085f2-c42d-4d6c-a074-c20fa299b92b None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:03.182539 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3085f2-c42d-4d6c-a074-c20fa299b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:03.261981 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-6c3085f2-c42d-4d6c-a074-c20fa299b92b None None] MFA Rules not processed for user `a583664454f04a79a0f43a418a9f1778`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:03.263200 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-6c3085f2-c42d-4d6c-a074-c20fa299b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:03.389567 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 517/1042] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Oct 13 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:03.397357 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:03.398931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:03.553322 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c517c3-0e74-4064-8bcd-a604e16c4664 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:03.574056 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:03.675719 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:03.676243 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:03.676520 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:03.676791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:03.678695 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:03.779483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:03.782272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd353a93-0660-4be1-941b-5f21936d0907 service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:03.804040 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 526/1043] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:03.911486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec18-5e95-4e53-9d77-3bf327fb04a8 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:03.911486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec18-5e95-4e53-9d77-3bf327fb04a8 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:03.911486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec18-5e95-4e53-9d77-3bf327fb04a8 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:03.911486 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 518/1044] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:03.916624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4024d3-b1f6-4c29-b889-6f0adeaf45c6 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:03.916923 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4024d3-b1f6-4c29-b889-6f0adeaf45c6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:03.917227 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4024d3-b1f6-4c29-b889-6f0adeaf45c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:03.956118 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:04.004066 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-9e4024d3-b1f6-4c29-b889-6f0adeaf45c6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:04.005731 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-9e4024d3-b1f6-4c29-b889-6f0adeaf45c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:04.129871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 527/1045] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:04.463391 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:04.463746 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:04.464196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:04.465948 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 519/1046] 10.222.0.13 () {54 vars in 963 bytes} [Thu Oct 13 04:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:04.471899 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14354-5d8a-4929-9803-ab90381b821f None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:04.472307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14354-5d8a-4929-9803-ab90381b821f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:04.472679 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14354-5d8a-4929-9803-ab90381b821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:04.554059 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f4b14354-5d8a-4929-9803-ab90381b821f None None] MFA Rules not processed for user `2e3c18f22aba448e8e26bec28cc24d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:04.555431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f4b14354-5d8a-4929-9803-ab90381b821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:04.605626 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:04.638060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 528/1047] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Oct 13 04:14:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:04.645699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:04.647209 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:04.699081 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:04.756515 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870cf08-4f53-4b19-86bb-e13ebe3fc569 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:04.841818 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3c18f22aba448e8e26bec28cc24d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:04.842452 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:04.842717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:04.842987 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:04.844658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:04.977235 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:04.997796 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:04.999812 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce8cf4-878e-4315-af0b-33f9ff67bf3f service cinder] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:05.026010 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 520/1048] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:06.051468 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:06.052003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:06.052003 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:06.053439 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 529/1049] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:06.058758 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda39d-b27a-4591-8bf1-e549e4246c0a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:06.059181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda39d-b27a-4591-8bf1-e549e4246c0a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:06.059436 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda39d-b27a-4591-8bf1-e549e4246c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:06.127408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-5fbda39d-b27a-4591-8bf1-e549e4246c0a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:06.128618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5fbda39d-b27a-4591-8bf1-e549e4246c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:06.227930 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 521/1050] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:06.520166 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:06.521769 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:06.680904 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9012b-8162-40c1-afbb-9ffa8355572c None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:06.732271 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:06.796230 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:06.796841 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:06.797195 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:06.797472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:06.799109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:06.893242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:06.894666 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f044f-ed38-43d8-934d-cf7239aa73dc service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:06.917013 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 530/1051] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:09.120908 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:09.121514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:09.121514 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:09.122961 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 522/1052] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:09.128082 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7aa1c-41dc-4f2c-b4bb-a26ab25e0c53 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:09.128503 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7aa1c-41dc-4f2c-b4bb-a26ab25e0c53 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:09.128644 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7aa1c-41dc-4f2c-b4bb-a26ab25e0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:09.197252 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ceb7aa1c-41dc-4f2c-b4bb-a26ab25e0c53 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:09.198436 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ceb7aa1c-41dc-4f2c-b4bb-a26ab25e0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:09.206527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:09.306596 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 531/1053] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:09.603549 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:09.605375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:09.670275 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:09.762203 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff47c-6d21-4905-b743-a023729a1385 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:09.882198 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:09.882969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:09.883354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:09.883735 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:09.885531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:09.905273 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:09.990018 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:09.991981 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1367efa-000a-46ef-8ecc-d83c8624c125 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:10.011038 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 523/1054] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:12.205050 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:12.205606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:12.205606 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:12.207146 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 532/1055] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:12.212062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f2ab-4af2-43b4-803a-e799951679bc None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:12.212469 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f2ab-4af2-43b4-803a-e799951679bc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:12.212676 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f2ab-4af2-43b4-803a-e799951679bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:12.283460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-b132f2ab-4af2-43b4-803a-e799951679bc None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:12.284812 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b132f2ab-4af2-43b4-803a-e799951679bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:12.398631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:12.404107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 524/1056] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:12.699144 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:12.700740 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:12.845410 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:12.860442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05aaad-e9aa-41f7-ad82-b203bfef03e1 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:12.985396 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:12.986004 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:12.986277 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:12.986552 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:12.988154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:13.087897 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:13.090223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344885b-2af2-40d2-a8e0-9c65dd513ae8 service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:13.103420 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:13.112292 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 533/1057] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:15.289255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:15.289761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:15.289986 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:15.291965 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 525/1058] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:15.297973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc620b6-d4a6-45ba-a781-35e19f932053 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:15.297973 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc620b6-d4a6-45ba-a781-35e19f932053 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:15.299577 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc620b6-d4a6-45ba-a781-35e19f932053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:15.364845 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-afc620b6-d4a6-45ba-a781-35e19f932053 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:15.366070 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-afc620b6-d4a6-45ba-a781-35e19f932053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:15.466833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 534/1059] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:15.752429 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:15.753972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:15.910221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2feece-ea81-48eb-99ce-20dcf8d12a0f None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:15.977184 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:16.033575 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:16.034435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:16.034815 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:16.035221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:16.037736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:16.129753 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:16.131350 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb537093-418f-47a4-814e-219774b5f9a9 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:16.149673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 526/1060] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:18.609469 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:18.610014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:18.610014 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:18.611349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 535/1061] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:18.616808 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34aed-c00e-423c-bc77-9c4cda555ed2 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:18.617266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34aed-c00e-423c-bc77-9c4cda555ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:18.617526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d34aed-c00e-423c-bc77-9c4cda555ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:18.682832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c8d34aed-c00e-423c-bc77-9c4cda555ed2 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:18.684032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c8d34aed-c00e-423c-bc77-9c4cda555ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:18.719886 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:18.784674 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 527/1062] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:19.074124 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:19.075762 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:19.154079 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:19.223944 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43c9d-207e-47a0-8036-f6b0f5c39b3f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:19.338318 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:19.338952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:19.339231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:19.339497 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:19.341065 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:19.381159 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:19.433479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:19.435068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22621d15-ad44-45ef-96ac-0b5cbc31ea58 service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:19.454184 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 536/1063] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:20.209842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6be87-d32b-4a22-a26c-654d0f852845 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:20.210389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6be87-d32b-4a22-a26c-654d0f852845 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:20.210389 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6be87-d32b-4a22-a26c-654d0f852845 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:20.211727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 528/1064] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:20.217009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31aff-ffe7-4001-b877-39be4bf0fecb None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:20.217462 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31aff-ffe7-4001-b877-39be4bf0fecb None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:20.217597 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31aff-ffe7-4001-b877-39be4bf0fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:20.286132 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b1c31aff-ffe7-4001-b877-39be4bf0fecb None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:20.287308 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b1c31aff-ffe7-4001-b877-39be4bf0fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:20.394824 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 537/1065] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:20.691060 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582391-902b-4de9-80a2-95475cd520eb None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:20.691347 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582391-902b-4de9-80a2-95475cd520eb None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:20.691626 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582391-902b-4de9-80a2-95475cd520eb None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:20.692953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 529/1066] 10.222.0.13 () {54 vars in 962 bytes} [Thu Oct 13 04:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:20.698170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784a6a-05f8-42b3-9a0a-2d111e05b9c9 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:20.698458 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784a6a-05f8-42b3-9a0a-2d111e05b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:20.698759 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784a6a-05f8-42b3-9a0a-2d111e05b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:20.714399 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:20.777397 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b9784a6a-05f8-42b3-9a0a-2d111e05b9c9 None None] MFA Rules not processed for user `c9f37ca9c5dd4d3f8a2aca825139d798`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:20.778582 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b9784a6a-05f8-42b3-9a0a-2d111e05b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:20.853921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 538/1067] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Oct 13 04:14:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:20.863434 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582391-902b-4de9-80a2-95475cd520eb None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:20.865096 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-af582391-902b-4de9-80a2-95475cd520eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:20.987972 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582391-902b-4de9-80a2-95475cd520eb None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:21.046315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:21.063615 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f37ca9c5dd4d3f8a2aca825139d798', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:21.064219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:21.064501 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:21.064773 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:21.066426 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:21.175294 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:21.176730 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721fb5-5c47-4fb7-929d-4bd9dbc55a0b service glance] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:21.194807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 530/1068] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:21.650951 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423300-6606-4f7d-8643-e67ab0964ec2 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:21.651546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423300-6606-4f7d-8643-e67ab0964ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:21.651546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423300-6606-4f7d-8643-e67ab0964ec2 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:21.652803 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 539/1069] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:21.658167 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749562ea-4c02-490c-99c1-3da4e071b367 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:21.658583 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749562ea-4c02-490c-99c1-3da4e071b367 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:21.658754 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749562ea-4c02-490c-99c1-3da4e071b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:21.727684 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-749562ea-4c02-490c-99c1-3da4e071b367 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:21.729185 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-749562ea-4c02-490c-99c1-3da4e071b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:21.779680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:21.844825 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 531/1070] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:21.933479 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e389-28f2-4fe5-9a59-174d28a639f8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:21.933830 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e389-28f2-4fe5-9a59-174d28a639f8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:21.934170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e389-28f2-4fe5-9a59-174d28a639f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:22.001813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-efe7e389-28f2-4fe5-9a59-174d28a639f8 None None] MFA Rules not processed for user `a9324eec4b3f44d186c1a426a9e01387`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:22.003023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-efe7e389-28f2-4fe5-9a59-174d28a639f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:22.057697 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:22.090589 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 540/1071] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Oct 13 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:22.131981 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:22.132272 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:22.132551 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:22.133960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 532/1072] 10.222.0.13 () {54 vars in 943 bytes} [Thu Oct 13 04:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:22.140676 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:22.140988 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:22.141296 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:22.141755 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:22.143271 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:22.218435 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] MFA Rules not processed for user `15838b36537140b7a402b54722e4594e`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:22.219533 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:22.291745 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968f5b6-c255-48c7-8a4e-309d364f7cbd None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:22.319303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:22.329424 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 541/1073] 10.222.0.13 () {58 vars in 1040 bytes} [Thu Oct 13 04:14:22 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:22.339073 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:22.349261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5b46-162d-4fcc-b7d3-10744cbf9020 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:22.375198 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:22.413470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:22.414084 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:22.414365 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:22.414634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:22.416237 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:22.455509 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15838b36537140b7a402b54722e4594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:22.456138 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:22.456413 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:22.457107 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:22.458317 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:22.510115 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:22.511636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a590e-d7f7-41aa-90e3-b252fffe583b service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:22.530157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 533/1074] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:22.542722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:22.544299 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718d7b-1e75-4751-82fe-d3883d520cf9 service swift] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:22.552718 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 542/1075] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Oct 13 04:14:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 04:14:24.723682 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:24.724269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:24.724269 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:24.732764 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654a9f0-fb9b-4c20-87c8-4589c0ed5c47 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:24.733293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654a9f0-fb9b-4c20-87c8-4589c0ed5c47 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:24.733404 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654a9f0-fb9b-4c20-87c8-4589c0ed5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:24.737219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 534/1076] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:24.820871 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-1654a9f0-fb9b-4c20-87c8-4589c0ed5c47 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:24.822259 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1654a9f0-fb9b-4c20-87c8-4589c0ed5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:24.833586 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:24.950210 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 543/1077] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:14:25.278005 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:25.279942 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:25.320354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:25.452150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022e5e-fbfc-4dce-aed0-3de1fd25390a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:25.564761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:25.576146 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:25.576751 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:25.577025 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:25.577331 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:25.581393 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:25.682095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:25.684036 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09384f4-b599-4884-9e83-a55e6f1c9f97 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:25.706172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 535/1078] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:27.930152 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:27.930704 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:27.930704 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:27.932203 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 544/1079] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:27.937478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5a61-82d5-4509-90c1-28c3a11f2350 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:27.937892 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5a61-82d5-4509-90c1-28c3a11f2350 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:27.938082 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5a61-82d5-4509-90c1-28c3a11f2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:28.010359 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-676d5a61-82d5-4509-90c1-28c3a11f2350 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:28.011581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-676d5a61-82d5-4509-90c1-28c3a11f2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:28.082117 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:28.125515 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 536/1080] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:28.417161 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:28.418801 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:28.571464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:28.585567 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab507a-0928-4132-9cdb-879def4b4187 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:28.711605 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:28.712221 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:28.712505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:28.712781 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:28.714414 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:28.816591 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:28.818338 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759c064-c416-4099-9d6b-63ce8d421588 service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:28.831164 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:28.849326 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 545/1081] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:31.058317 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:31.058888 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:31.058888 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:31.060177 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 537/1082] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:31.065927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51154-fac6-4851-b6b8-d70603af8ed2 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:31.066352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51154-fac6-4851-b6b8-d70603af8ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:31.066508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51154-fac6-4851-b6b8-d70603af8ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:31.136921 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b8b51154-fac6-4851-b6b8-d70603af8ed2 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:31.138730 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b8b51154-fac6-4851-b6b8-d70603af8ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:31.242380 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 546/1083] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:31.528544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:31.531021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:31.694581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca32b04-4d72-40d3-96ed-b9509b676618 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:31.757107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:31.831116 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:31.831729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:31.832011 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:31.832284 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:31.833953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:31.939480 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:31.941114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cd6d2-6075-431d-b72d-319af39ecfad service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:31.969337 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 538/1084] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:41.240646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=67 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:41.958577 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=76 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:45.281086 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f38d-6a6a-4699-b4b3-be3b740d815e None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:45.281722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f38d-6a6a-4699-b4b3-be3b740d815e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:45.281722 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f38d-6a6a-4699-b4b3-be3b740d815e None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:45.283012 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 547/1085] 10.222.0.13 () {54 vars in 918 bytes} [Thu Oct 13 04:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:45.288053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a14a-1684-4020-9466-8c2a97843d2f None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:45.288479 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a14a-1684-4020-9466-8c2a97843d2f None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:45.288599 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19a14a-1684-4020-9466-8c2a97843d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:45.363935 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-ab19a14a-1684-4020-9466-8c2a97843d2f None None] MFA Rules not processed for user `2684230fec514081920eccfd57e47678`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:45.365159 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-ab19a14a-1684-4020-9466-8c2a97843d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:45.467833 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 539/1086] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Oct 13 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:45.482093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1a41-939e-46d6-a6fe-c11ff2969a53 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:45.482399 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1a41-939e-46d6-a6fe-c11ff2969a53 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:45.482674 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1a41-939e-46d6-a6fe-c11ff2969a53 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:45.484024 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 548/1087] 10.222.0.13 () {54 vars in 918 bytes} [Thu Oct 13 04:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:45.488588 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e62fe-41b0-4ae0-8a89-1a01683f439a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:45.488869 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e62fe-41b0-4ae0-8a89-1a01683f439a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:45.489157 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e62fe-41b0-4ae0-8a89-1a01683f439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:45.560728 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:45.563658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-256e62fe-41b0-4ae0-8a89-1a01683f439a None None] MFA Rules not processed for user `a583664454f04a79a0f43a418a9f1778`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:45.565419 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-256e62fe-41b0-4ae0-8a89-1a01683f439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:45.677059 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 540/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Oct 13 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:48.224639 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:48.225315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:48.225315 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:48.226556 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 549/1089] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:48.232247 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390c7b-2f62-4aa0-af50-700e54cdf603 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:48.232631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390c7b-2f62-4aa0-af50-700e54cdf603 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:48.232875 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d390c7b-2f62-4aa0-af50-700e54cdf603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:48.300943 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-5d390c7b-2f62-4aa0-af50-700e54cdf603 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:48.302187 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5d390c7b-2f62-4aa0-af50-700e54cdf603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:48.359174 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:48.400278 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 541/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:48.686564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:48.688140 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:48.831696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79cbd-9b1f-4cab-b1f9-21f72658a5bb None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:48.902240 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:48.942383 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:48.942914 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:48.943189 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:48.943455 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:48.945028 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:49.033715 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:49.035293 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c8f29-0831-4760-9e29-a2e753fa905a service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:49.052828 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 550/1091] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:50.176208 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:50.176787 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:50.176888 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:50.178280 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 542/1092] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:50.184712 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21902a73-1d76-4cd4-92d5-d5d60c63809f None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:50.185178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21902a73-1d76-4cd4-92d5-d5d60c63809f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:50.185291 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21902a73-1d76-4cd4-92d5-d5d60c63809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:50.260044 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-21902a73-1d76-4cd4-92d5-d5d60c63809f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:50.261267 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-21902a73-1d76-4cd4-92d5-d5d60c63809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:50.287598 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:50.356182 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 551/1093] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:50.504572 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:50.506080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:50.647112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c04d-1641-4517-bdde-d4e6f0e38fd5 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:50.688255 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:50.759800 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:50.760305 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:50.760580 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:50.760853 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:50.762458 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:50.849421 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:50.850989 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e299a-d73b-44db-a3aa-0a78686f320a service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:50.868525 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 543/1094] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:52.000980 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:52.001620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:52.001620 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:52.002907 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 552/1095] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:52.009198 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f5d1-0878-436c-9ed4-182258d33310 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:52.009621 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f5d1-0878-436c-9ed4-182258d33310 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:52.009759 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f5d1-0878-436c-9ed4-182258d33310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:52.064378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:52.086362 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-7976f5d1-0878-436c-9ed4-182258d33310 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:52.087567 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7976f5d1-0878-436c-9ed4-182258d33310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:52.182473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 544/1096] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:52.333997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:52.335525 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:52.479522 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc72a6-62ed-404f-ba14-03d1ddaf84ba None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:52.491848 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:52.590313 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:52.590842 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:52.591122 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:52.591394 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:52.593544 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:52.681742 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:52.683307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4566ac-c041-471d-980f-671f69066b1e service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:52.700535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 553/1097] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:53.799328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:53.799899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:53.799899 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:53.801219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 545/1098] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:53.807237 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf79b-fc80-4f61-8698-ba847c4d245e None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:53.807724 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf79b-fc80-4f61-8698-ba847c4d245e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:53.807838 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cf79b-fc80-4f61-8698-ba847c4d245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:53.828242 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:53.884590 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-b52cf79b-fc80-4f61-8698-ba847c4d245e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:53.885870 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-b52cf79b-fc80-4f61-8698-ba847c4d245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:53.980857 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 554/1099] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:54.129538 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:54.130976 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:54.239199 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:54.275562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60cc0c-6105-47f7-922d-c1a92425b4bd None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:54.387492 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:54.388065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:54.388342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:54.388618 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:54.390312 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:54.465299 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:54.478680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:54.480264 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3a4b-fd37-4df2-97a9-b6e5ffcbad8c service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:54.498825 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 546/1100] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:55.593425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:55.594040 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:55.594040 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:55.595247 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 555/1101] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:55.601450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9e02-4f4b-4b87-a100-e465c1f4a521 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:55.601916 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9e02-4f4b-4b87-a100-e465c1f4a521 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:55.602024 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9e02-4f4b-4b87-a100-e465c1f4a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:55.678100 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-97af9e02-4f4b-4b87-a100-e465c1f4a521 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:55.679293 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-97af9e02-4f4b-4b87-a100-e465c1f4a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:55.773251 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 547/1102] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:55.921312 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:55.922836 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:56.007495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:56.070492 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f58cc-34da-45fa-81c1-d9ca90219129 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:56.181675 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:56.182205 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:56.182494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:56.182755 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:56.184342 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:56.232981 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:56.274438 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:56.276009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8368f2-75cc-40a8-9702-73f64b51584a service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:56.293425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 556/1103] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:57.341531 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:57.342554 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:57.342657 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:57.344002 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 548/1104] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:57.350604 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c0dc-d74f-441f-91c2-f6c3d93afdab None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:57.351055 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c0dc-d74f-441f-91c2-f6c3d93afdab None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:57.351213 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c0dc-d74f-441f-91c2-f6c3d93afdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:57.425955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-68d9c0dc-d74f-441f-91c2-f6c3d93afdab None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:57.427151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-68d9c0dc-d74f-441f-91c2-f6c3d93afdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:57.522852 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 557/1105] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:57.675731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:57.677334 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:57.724785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:57.821246 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f0a0b-be68-4cb8-ac7e-dfd679b33444 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:57.933254 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:57.933793 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:57.934071 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:57.934342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:57.936532 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:57.943310 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:58.028985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:58.030669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f206c-ca12-4db1-b845-a07e4483ca66 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:58.048985 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 549/1106] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:14:59.097442 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:59.098018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:59.098018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:59.099514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 558/1107] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:14:59.105766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb04-6395-40d5-9080-61034421ad8d None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:59.106176 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb04-6395-40d5-9080-61034421ad8d None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:59.106303 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66eb04-6395-40d5-9080-61034421ad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:59.181082 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-bc66eb04-6395-40d5-9080-61034421ad8d None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:14:59.182308 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-bc66eb04-6395-40d5-9080-61034421ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:59.248785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:59.276938 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 550/1108] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:14:59.426393 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:14:59.427955 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:59.445092 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:59.571923 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d762-95da-4103-96c6-5fe6c81dae00 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:14:59.658023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:14:59.683416 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:14:59.683956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:14:59.684236 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:14:59.684508 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:14:59.686723 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:14:59.774792 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:14:59.776402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5d6b-6909-4d42-9922-3748c48907e6 service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:14:59.796194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 559/1109] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:00.840550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:00.841166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:00.841166 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:00.842993 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 551/1110] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:00.849049 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe0c9-048b-410d-9636-e9f9d6d6dbc2 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:00.849474 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe0c9-048b-410d-9636-e9f9d6d6dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:00.849628 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe0c9-048b-410d-9636-e9f9d6d6dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:00.923930 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-ba3fe0c9-048b-410d-9636-e9f9d6d6dbc2 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:00.925100 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ba3fe0c9-048b-410d-9636-e9f9d6d6dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:00.967946 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:01.021502 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 560/1111] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:01.170457 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:01.171964 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:01.313669 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784728c1-c0f0-4896-b125-3a5e0c02e922 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:01.368650 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:01.426021 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:01.426563 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:01.426842 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:01.427114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:01.428699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:01.517635 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:01.519226 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39c87b-16dc-4950-8b37-f3faa6da7364 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:01.536736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 552/1112] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:02.586572 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:02.587111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:02.587111 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:02.588422 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 561/1113] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 04:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:02.594550 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4318a-2e9f-4421-b4cb-e990bcc26fa7 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:02.594968 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4318a-2e9f-4421-b4cb-e990bcc26fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:02.595095 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4318a-2e9f-4421-b4cb-e990bcc26fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:02.671091 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c5f4318a-2e9f-4421-b4cb-e990bcc26fa7 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:02.673051 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c5f4318a-2e9f-4421-b4cb-e990bcc26fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:02.675600 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:02.774298 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 553/1114] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 04:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:02.924010 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:02.925565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:03.066876 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066818e-c558-4358-9995-ed09fd00b351 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:03.093412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:03.178349 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:03.178875 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:03.179154 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:03.179425 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:03.181011 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:03.268952 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:03.270565 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404af61f-bd63-48ab-b637-7537a5e0febd service nova] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:03.288654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 562/1115] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:05.366598 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:05.367109 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:05.367219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:05.368478 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 554/1116] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:05.373757 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c37844-236f-422c-a21f-9863979341a9 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:05.374196 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c37844-236f-422c-a21f-9863979341a9 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:05.374300 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c37844-236f-422c-a21f-9863979341a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:05.415216 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:05.440309 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-40c37844-236f-422c-a21f-9863979341a9 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:05.441562 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-40c37844-236f-422c-a21f-9863979341a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:05.538037 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 563/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:05.831962 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:05.833589 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:05.933646 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc1376-48e9-4789-8171-55d68c16de22 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:05.966713 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:06.007526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:06.008128 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:06.008403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:06.008671 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:06.010339 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:06.120678 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:06.122061 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425c881-2068-4a36-9b6e-13c5ec9cf298 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:06.139992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 555/1118] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:08.417997 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:08.418551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:08.418551 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:08.419926 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 564/1119] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:08.425284 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01b3b6-f3f8-4f2f-9a2f-488d98b25a9a None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:08.425721 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01b3b6-f3f8-4f2f-9a2f-488d98b25a9a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:08.425867 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01b3b6-f3f8-4f2f-9a2f-488d98b25a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:08.491028 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-2f01b3b6-f3f8-4f2f-9a2f-488d98b25a9a None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:08.492221 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2f01b3b6-f3f8-4f2f-9a2f-488d98b25a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:08.504686 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:08.587408 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 556/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:08.871051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:08.872608 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:08.973665 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2a00-e46c-494d-af14-57ef3eadfab3 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:08.986987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:09.047739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:09.048337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:09.048613 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:09.048881 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:09.050486 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:09.155615 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:09.156956 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee277-a0be-4ec0-bd11-be8e3f22f956 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:09.174272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 565/1121] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:11.614131 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:11.614673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:11.614673 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:11.615937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 557/1122] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:11.621373 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3c16-e811-45c3-b256-2790402e0ab3 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:11.621813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3c16-e811-45c3-b256-2790402e0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:11.621919 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af3c16-e811-45c3-b256-2790402e0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:11.670359 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:11.688472 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-f7af3c16-e811-45c3-b256-2790402e0ab3 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:11.689685 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-f7af3c16-e811-45c3-b256-2790402e0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:11.792009 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 566/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:12.078861 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:12.080397 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:12.180913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc331ac-b2cd-4ebe-8ea0-c68c70618c5a None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:12.219938 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:12.254232 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:12.254829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:12.255104 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:12.255370 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:12.256940 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:12.362828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:12.364267 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0db954-ef8a-4452-800d-009844c10d6d service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:12.382244 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 558/1124] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 04:15:14.642646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:14.643178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:14.643178 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:14.644440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 567/1125] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:14.649699 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbacd1-4d34-415e-a6aa-26df931fab4e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:14.650112 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbacd1-4d34-415e-a6aa-26df931fab4e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:14.650263 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbacd1-4d34-415e-a6aa-26df931fab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:14.715375 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-24bbacd1-4d34-415e-a6aa-26df931fab4e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:14.716608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-24bbacd1-4d34-415e-a6aa-26df931fab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:14.737776 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:14.817731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 559/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:15.101957 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:15.103791 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:15.205333 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dde56-1118-4fc3-959a-453e5a793b2d None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:15.225109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:15.277625 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:15.278230 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:15.279067 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:15.279321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:15.280905 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:15.390053 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:15.391412 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8f9ee-e78f-4f7a-a2ec-64c3ba07a112 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:15.409610 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 568/1127] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:17.696581 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:17.697105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:17.697105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:17.698495 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 560/1128] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:17.704386 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1272a2f-20fd-4295-80e4-943d99e8e0fe None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:17.704859 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1272a2f-20fd-4295-80e4-943d99e8e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:17.704957 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1272a2f-20fd-4295-80e4-943d99e8e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:17.768514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:17.771231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-d1272a2f-20fd-4295-80e4-943d99e8e0fe None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:17.773043 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-d1272a2f-20fd-4295-80e4-943d99e8e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:17.869546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 569/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:18.157256 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:18.158795 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:18.260718 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879603d9-c6a1-4786-a98f-dd6a00d9ec0e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:18.308358 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:18.335784 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:18.336384 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:18.336658 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:18.336937 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:18.338530 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:18.445266 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:18.446740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aef127-1f1c-412d-80e3-b490b906fc14 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:18.464382 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 561/1130] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:20.644107 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:20.644646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:20.644646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:20.645987 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 570/1131] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:20.651383 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445308-9053-4da9-8de1-10c0753eb814 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:20.651809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445308-9053-4da9-8de1-10c0753eb814 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:20.651921 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445308-9053-4da9-8de1-10c0753eb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:20.717631 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-53445308-9053-4da9-8de1-10c0753eb814 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:20.718823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-53445308-9053-4da9-8de1-10c0753eb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:20.747610 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:20.814062 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 562/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:21.101850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:21.103640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:21.205272 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e5a-25be-4922-8458-734cd1d4ecc4 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:21.233622 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:21.277651 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:21.278252 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:21.278594 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:21.278861 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:21.280422 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:21.387093 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:21.388467 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d823a-0b69-49aa-87ee-b6d4c544956a service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:21.405885 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 571/1133] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:23.587966 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:23.588494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:23.588494 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:23.589835 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 563/1134] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:23.595017 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9dea-8c0d-40e1-9c4a-95b334c4cfd8 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:23.595440 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9dea-8c0d-40e1-9c4a-95b334c4cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:23.595638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f9dea-8c0d-40e1-9c4a-95b334c4cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:23.660495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-4c5f9dea-8c0d-40e1-9c4a-95b334c4cfd8 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:23.661716 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-4c5f9dea-8c0d-40e1-9c4a-95b334c4cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:23.670413 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:23.758060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 572/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:24.038592 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:24.040151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:24.143150 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cb568-a92d-41bc-87f3-661f28c6aa70 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:24.196995 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:24.215432 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:24.216636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:24.216913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:24.217215 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:24.218809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:24.324386 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:24.326279 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb4ec-6369-4800-ab80-5dcabe38f7d7 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:24.344500 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 564/1136] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:26.525569 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb223523-d546-4afc-a143-09558e2a698e None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:26.526165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb223523-d546-4afc-a143-09558e2a698e None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:26.526165 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb223523-d546-4afc-a143-09558e2a698e None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:26.527483 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 573/1137] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:26.532840 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b504-0489-4165-acac-dd16a2ae4f19 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:26.533357 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b504-0489-4165-acac-dd16a2ae4f19 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:26.533460 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390b504-0489-4165-acac-dd16a2ae4f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:26.597945 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-c390b504-0489-4165-acac-dd16a2ae4f19 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:26.599066 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-c390b504-0489-4165-acac-dd16a2ae4f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:26.637325 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:26.693799 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 565/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:26.974913 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb223523-d546-4afc-a143-09558e2a698e None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:26.976446 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-eb223523-d546-4afc-a143-09558e2a698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:27.079751 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb223523-d546-4afc-a143-09558e2a698e None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:27.119431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:27.155426 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:27.156023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:27.156297 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:27.156564 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:27.158173 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:27.263962 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:27.265337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d7d89-c4d5-47da-b120-72746f796078 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:27.283286 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 574/1139] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:29.422080 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:29.422636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:29.422636 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:29.423969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 566/1140] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:29.429141 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde378-861a-4d6b-a77c-f8cf24f4cb85 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:29.429546 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde378-861a-4d6b-a77c-f8cf24f4cb85 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:29.429714 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde378-861a-4d6b-a77c-f8cf24f4cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:29.495299 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-73fde378-861a-4d6b-a77c-f8cf24f4cb85 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:29.496505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-73fde378-861a-4d6b-a77c-f8cf24f4cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:29.514748 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:29.594187 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 575/1141] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:15:29.874497 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:29.876032 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:29.978955 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd44e-9de2-4131-b44c-0904427c86fc None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:30.045441 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:30.052279 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:30.052880 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:30.053181 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:30.053455 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:30.055057 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:30.161422 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:30.162844 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088963e-b897-4f39-b691-5febbe7dbe68 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:30.180173 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 567/1142] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:32.323390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:32.323950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:32.323950 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:32.325920 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 576/1143] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 04:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:32.331354 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48a8a-a306-4b5f-a88a-761aa19c5c0e None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:32.331729 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48a8a-a306-4b5f-a88a-761aa19c5c0e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:32.331890 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48a8a-a306-4b5f-a88a-761aa19c5c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:32.396546 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-d9d48a8a-a306-4b5f-a88a-761aa19c5c0e None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:32.397761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d9d48a8a-a306-4b5f-a88a-761aa19c5c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:32.443970 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:32.491661 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 568/1144] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 04:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:32.767640 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:32.769207 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:32.879915 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0119c0-8161-4bf9-91b1-243d9814c76f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:32.929105 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:32.954478 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:32.955081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:32.955361 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:32.955634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:32.957255 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:33.064856 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:33.066223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30e90-b3f0-4825-9512-3c61632243e8 service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:33.084638 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 577/1145] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:42.490196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=22 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:43.082390 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=66 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:52.874523 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e94-c5ec-4885-893f-3a160914c205 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:52.875098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e94-c5ec-4885-893f-3a160914c205 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:52.875098 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e94-c5ec-4885-893f-3a160914c205 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:52.876407 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 569/1146] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:52.881679 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c537f-4a61-4e5a-ab0c-fb6e23dc44d6 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:52.882106 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c537f-4a61-4e5a-ab0c-fb6e23dc44d6 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:52.882219 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c537f-4a61-4e5a-ab0c-fb6e23dc44d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:52.947537 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-5b0c537f-4a61-4e5a-ab0c-fb6e23dc44d6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:52.948739 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-5b0c537f-4a61-4e5a-ab0c-fb6e23dc44d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:53.047653 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 578/1147] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:53.346039 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:53.346325 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:53.346624 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:53.347969 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 570/1148] 10.222.0.13 () {54 vars in 962 bytes} [Thu Oct 13 04:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:53.352931 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2db02-878d-4249-889d-5d12c9d02a23 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:53.353261 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2db02-878d-4249-889d-5d12c9d02a23 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:53.353535 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2db02-878d-4249-889d-5d12c9d02a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:53.428833 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-c7e2db02-878d-4249-889d-5d12c9d02a23 None None] MFA Rules not processed for user `c9f37ca9c5dd4d3f8a2aca825139d798`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:53.430050 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-c7e2db02-878d-4249-889d-5d12c9d02a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:53.450550 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:53.505677 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 579/1149] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Oct 13 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:53.513315 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:53.514857 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:53.615873 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077a5d1-859a-4b48-8ea1-b3e511a9ca59 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:53.688711 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9f37ca9c5dd4d3f8a2aca825139d798', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:53.689336 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:53.689616 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:53.689885 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:53.691470 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:53.743979 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:53.798526 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:53.799959 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335e94-158e-421e-95cb-f80c1247cbe4 service glance] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:53.818103 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 571/1150] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:15:56.025844 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bef93-220e-4782-b392-d44f83a04231 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:56.026402 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bef93-220e-4782-b392-d44f83a04231 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:56.026654 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bef93-220e-4782-b392-d44f83a04231 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:56.028851 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 580/1151] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:56.034034 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc192-7138-430a-9b22-073f545ecb86 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:56.034465 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc192-7138-430a-9b22-073f545ecb86 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:56.034589 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fc192-7138-430a-9b22-073f545ecb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:56.099780 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-7f3fc192-7138-430a-9b22-073f545ecb86 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:56.100974 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-7f3fc192-7138-430a-9b22-073f545ecb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:56.195712 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 572/1152] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:56.473966 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bef93-220e-4782-b392-d44f83a04231 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:56.475543 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-199bef93-220e-4782-b392-d44f83a04231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:56.599625 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bef93-220e-4782-b392-d44f83a04231 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:56.648788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:56.693603 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:56.694215 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:56.694495 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:56.694767 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:56.695400 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:56.696527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:15:56.696527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:15:56.696527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:15:56.697720 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5f3c-a7b7-48a8-b574-7d666dd50e1b admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:56.716248 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 581/1153] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Oct 13 04:15:56 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:15:58.852219 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:58.852828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:58.852828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:58.854397 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 573/1154] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:15:58.860226 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ebbc-75c5-4061-991b-2d48e1a5c32c None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:58.860634 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ebbc-75c5-4061-991b-2d48e1a5c32c None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:58.860769 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ebbc-75c5-4061-991b-2d48e1a5c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:58.924868 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-0f92ebbc-75c5-4061-991b-2d48e1a5c32c None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:15:58.926102 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-0f92ebbc-75c5-4061-991b-2d48e1a5c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:59.021958 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 582/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:15:59.313781 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:15:59.315472 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:59.326148 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:59.462777 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e856-494a-45fc-ad01-4f4c5150bcd1 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:15:59.544544 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:15:59.575634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a583664454f04a79a0f43a418a9f1778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:15:59.576172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:15:59.576450 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:15:59.576717 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:15:59.578356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:15:59.665507 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:15:59.667090 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417dcc-8ffd-48ff-8aad-7a735f36d4f9 service nova] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:15:59.686178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 574/1156] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:16:01.994619 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:01.995194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:01.995194 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:01.997169 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 583/1157] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:16:02.002443 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98afe-651c-4152-8874-bec42fed4ad6 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:02.002883 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98afe-651c-4152-8874-bec42fed4ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:02.002992 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98afe-651c-4152-8874-bec42fed4ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:02.067453 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-67b98afe-651c-4152-8874-bec42fed4ad6 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:16:02.068639 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-67b98afe-651c-4152-8874-bec42fed4ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:02.114310 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:02.164050 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 575/1158] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:16:02.451554 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:16:02.453107 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:02.476935 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:02.555112 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b8a4c-0a5a-4e5a-8667-1082d3407dfc None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:16:02.628234 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:16:02.628771 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:02.629048 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:02.629347 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:02.630932 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:02.703528 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:02.738352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:16:02.739765 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44139d-b7bf-4582-b668-ad79fda4fbcd service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:16:02.757696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 584/1159] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:16:04.935838 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:04.936404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:04.936404 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:04.937766 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 576/1160] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:16:04.943251 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefb57-dddc-47e2-a43d-aa1acd7a8962 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:04.943684 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefb57-dddc-47e2-a43d-aa1acd7a8962 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:04.943794 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefb57-dddc-47e2-a43d-aa1acd7a8962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:05.009596 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-cbeefb57-dddc-47e2-a43d-aa1acd7a8962 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:16:05.010798 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-cbeefb57-dddc-47e2-a43d-aa1acd7a8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:05.107324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 585/1161] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:16:05.397356 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:16:05.398891 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:05.502105 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52aac-9700-4846-95d0-3a76e1fba361 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:16:05.572806 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:05.574281 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:16:05.574953 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:05.575241 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:05.575709 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:05.577718 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:05.684042 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:16:05.685499 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35929-b3f9-4364-b86e-fbfab7f23855 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:16:05.703253 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 577/1162] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:16:07.916109 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:07.916652 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:07.916652 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:07.918026 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 586/1163] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:16:07.923871 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a755b-ad8d-4f96-a31c-ad1ee6e18c05 None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:07.924297 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a755b-ad8d-4f96-a31c-ad1ee6e18c05 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:07.924435 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a755b-ad8d-4f96-a31c-ad1ee6e18c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:07.990123 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-e53a755b-ad8d-4f96-a31c-ad1ee6e18c05 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:16:07.991319 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e53a755b-ad8d-4f96-a31c-ad1ee6e18c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:08.045405 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:08.088369 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 578/1164] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:16:08.390399 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:16:08.391961 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:08.427942 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:08.494561 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5d82e-09f0-4e4b-9317-7009a1f6cbd1 None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:16:08.567059 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:16:08.567646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:08.567927 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:08.568191 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:08.569785 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:08.647023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:08.675983 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:16:08.677437 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81d02-3166-4d60-90ad-79072cf6e9dc service neutron] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:16:08.695514 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 587/1165] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:16:11.030856 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:11.031423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:11.031423 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:11.032753 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 579/1166] 10.222.0.13 () {54 vars in 927 bytes} [Thu Oct 13 04:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:16:11.038231 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907c1d-7926-414f-abc5-107664219199 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:11.038655 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907c1d-7926-414f-abc5-107664219199 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:11.038772 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907c1d-7926-414f-abc5-107664219199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:11.103573 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-a6907c1d-7926-414f-abc5-107664219199 None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:16:11.105018 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a6907c1d-7926-414f-abc5-107664219199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:11.198656 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 588/1167] 10.222.0.13 () {58 vars in 1024 bytes} [Thu Oct 13 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:16:11.488970 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:16:11.490603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:11.594855 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c480-3e0f-4881-a0bb-46e4e3e7f56e None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:16:11.666823 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:16:11.667418 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:16:11.667690 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:16:11.667957 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:16:11.670076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:16:11.678325 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:11.779300 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:16:11.780747 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc09062-a770-48e6-8045-706c65322537 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:16:11.799092 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 580/1168] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:16:21.197068 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=82 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:16:21.796829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=50 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:30.836413 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:30.837005 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:30.837005 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:30.912262 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:17:30.913505 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.011147 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 589/1169] 10.222.0.13 () {58 vars in 958 bytes} [Thu Oct 13 04:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:17:31.019114 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.019590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.019736 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.093634 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.auth.core [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:17:31.094761 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.189726 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 581/1170] 10.222.0.13 () {58 vars in 958 bytes} [Thu Oct 13 04:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:17:31.194352 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.195538 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.206646 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211c56-2f65-4e49-8ec8-488c75a4567f None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:31.266696 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:31.300405 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:31.301007 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.301321 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.301595 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] PATH_INFO: `/v3/domains` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.302238 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 04:17:31.302541 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:31.303548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:31.303548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:17:31.303548 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:17:31.304431 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:31.315494 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 590/1171] 10.222.0.13 () {58 vars in 1153 bytes} [Thu Oct 13 04:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 04:17:31.325473 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.334706 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3bec6-b0c2-48ae-b2a4-fc6b4934c8ff None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:31.395342 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:31.428637 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:31.429288 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.429574 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.429849 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.430490 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:31.431603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING py.warnings [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:31.431603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: warnings.warn(msg) Oct 13 04:17:31.431603 dv-cinder-860997-1-smb devstack@keystone.service[81311]: Oct 13 04:17:31.432795 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:31.488590 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 582/1172] 10.222.0.13 () {60 vars in 1153 bytes} [Thu Oct 13 04:17:31 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 04:17:31.492816 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.494825 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.527873 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282cb9c-0d34-4ffb-ab62-42b4bab0810d admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:31.619917 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:31.620512 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.620800 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.621051 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.621708 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:31.622701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:31.622701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:17:31.622701 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:17:31.623898 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:31.667303 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 591/1173] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Oct 13 04:17:31 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 04:17:31.671461 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.672984 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.734055 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887132e-f2ed-4cee-8a5b-e897c65bf2d1 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:31.818515 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:31.830250 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:31.830855 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.831132 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.831403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.832065 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:31.833686 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:31.845772 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 583/1174] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Oct 13 04:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:17:31.849813 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.851324 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:31.862858 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90210-4086-421e-bb72-15e12a4723f8 admin admin] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:31.887826 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:31.956276 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:31.956806 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:31.957081 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:31.957375 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:31.958016 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:31.959580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4b11-db61-4cfb-8820-ccc9d2843b3e admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:31.973060 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 592/1175] 10.222.0.13 () {58 vars in 1122 bytes} [Thu Oct 13 04:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 04:17:31.977328 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:31.979445 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.013076 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd6202-f944-48c9-82aa-c6546befa0b5 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:32.105731 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:32.106387 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.106666 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.106941 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] PATH_INFO: `/v3/projects/78a05ffcfed84dae95f090e6bfb59ba3/users/f7d1b5c821de4282b7177b4be4740a91/roles/3a9f5bd18c8140c89d65305279cf6577` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.129008 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a05ffcfed84dae95f090e6bfb59ba3, user_id=f7d1b5c821de4282b7177b4be4740a91, role_id=3a9f5bd18c8140c89d65305279cf6577)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:32.131832 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4824c-d91b-470d-a4fb-ec5a05f72bae admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:32.156693 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 584/1176] 10.222.0.13 () {60 vars in 1483 bytes} [Thu Oct 13 04:17:31 2022] PUT /identity/v3/projects/78a05ffcfed84dae95f090e6bfb59ba3/users/f7d1b5c821de4282b7177b4be4740a91/roles/3a9f5bd18c8140c89d65305279cf6577 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:17:32.168337 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5e327-623b-4ebc-84c0-f5ed40222413 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.168624 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5e327-623b-4ebc-84c0-f5ed40222413 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.168899 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5e327-623b-4ebc-84c0-f5ed40222413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.224604 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-bfd5e327-623b-4ebc-84c0-f5ed40222413 None None] MFA Rules not processed for user `f7d1b5c821de4282b7177b4be4740a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:17:32.225750 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-bfd5e327-623b-4ebc-84c0-f5ed40222413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.303208 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 593/1177] 10.222.0.13 () {58 vars in 958 bytes} [Thu Oct 13 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:17:32.316371 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.316743 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.317086 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] PATH_INFO: `/` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.318528 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 585/1178] 10.222.0.13 () {54 vars in 963 bytes} [Thu Oct 13 04:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:17:32.324023 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d8ed-a76b-4631-ab44-17e2f229cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.324306 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d8ed-a76b-4631-ab44-17e2f229cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.324580 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d8ed-a76b-4631-ab44-17e2f229cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.356170 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:32.401358 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-7721d8ed-a76b-4631-ab44-17e2f229cdb5 None None] MFA Rules not processed for user `2e3c18f22aba448e8e26bec28cc24d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:17:32.402566 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-7721d8ed-a76b-4631-ab44-17e2f229cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.475578 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Oct 13 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 04:17:32.484233 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:32.485779 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.534594 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:32.587828 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93237a-fb22-479b-add0-8e9ac4a44602 None None] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:32.661689 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3c18f22aba448e8e26bec28cc24d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:32.662287 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.662562 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.662829 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.664401 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.761960 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:32.763334 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:32.766809 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:32.781961 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 586/1180] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:17:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:17:32.826671 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb086-9bd6-4d02-a5e2-f3c0d64b04ec None None] REQUEST_METHOD: `GET` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:32.826960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb086-9bd6-4d02-a5e2-f3c0d64b04ec None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:32.827262 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb086-9bd6-4d02-a5e2-f3c0d64b04ec None None] PATH_INFO: `/` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:32.828527 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 595/1181] 10.222.0.13 () {52 vars in 830 bytes} [Thu Oct 13 04:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 04:17:32.832077 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:32.833312 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:32.931172 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b94498-90b7-441f-98d6-943ba5249e72 service cinder] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:33.023053 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:33.023606 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:33.023884 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:33.024151 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] PATH_INFO: `/v3/users/f7d1b5c821de4282b7177b4be4740a91` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:33.036680 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d1b5c821de4282b7177b4be4740a91)` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:33.037740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: WARNING py.warnings [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:33.037740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: warnings.warn(msg) Oct 13 04:17:33.037740 dv-cinder-860997-1-smb devstack@keystone.service[81311]: Oct 13 04:17:33.038951 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:33.048913 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=100 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:33.103178 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d1b5c821de4282b7177b4be4740a91'} {{(pid=81311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:33.126608 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d1b5c821de4282b7177b4be4740a91'} {{(pid=81311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:33.127196 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d1b5c821de4282b7177b4be4740a91'} {{(pid=81311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:33.136587 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d1b5c821de4282b7177b4be4740a91'} {{(pid=81311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:33.137234 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.notifications [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d1b5c821de4282b7177b4be4740a91'} {{(pid=81311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:33.156807 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 587/1182] 10.222.0.13 () {58 vars in 1224 bytes} [Thu Oct 13 04:17:32 2022] DELETE /identity/v3/users/f7d1b5c821de4282b7177b4be4740a91 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:17:33.161223 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] REQUEST_METHOD: `POST` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:33.161691 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:33.161788 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:33.218129 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.auth.core [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] MFA Rules not processed for user `b3e214467c9d452dbed4bb39c743bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 04:17:33.219307 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:33.294143 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=100 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:33.306796 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 596/1183] 10.222.0.13 () {58 vars in 958 bytes} [Thu Oct 13 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 04:17:33.316565 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Authenticating user token {{(pid=81311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:33.317822 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:33.418107 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e6cf-17c4-468e-a7ed-353691917a49 admin admin] Validating token access rules against request {{(pid=81311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:33.471727 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:33.492582 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32d83c87e17740eb943517d7f5503817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f68f0139704babad0653d3c0dcd153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:33.493225 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:33.493508 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:33.493785 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:33.495378 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.fernet_utils [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:33.603403 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:33.605601 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5745ee2-5d04-4525-aa55-50010159c0b5 service neutron] RBAC: Authorization granted {{(pid=81311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:33.624046 dv-cinder-860997-1-smb devstack@keystone.service[81311]: [pid: 81311|app: 0|req: 588/1184] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Oct 13 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 04:17:33.953960 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] Authenticating user token {{(pid=81310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 04:17:33.955175 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.fernet_utils [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 04:17:33.967254 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddccc2-37c4-41a0-88cc-df6a268feaaf None None] Validating token access rules against request {{(pid=81310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 04:17:34.063938 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e214467c9d452dbed4bb39c743bbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '943bb932238542588166ff5bb66e3c95', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 04:17:34.064572 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 04:17:34.064850 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 04:17:34.065123 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] PATH_INFO: `/v3/projects/78a05ffcfed84dae95f090e6bfb59ba3` {{(pid=81310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 04:17:34.074849 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a05ffcfed84dae95f090e6bfb59ba3)` {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 04:17:34.075867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: WARNING py.warnings [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 04:17:34.075867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: warnings.warn(msg) Oct 13 04:17:34.075867 dv-cinder-860997-1-smb devstack@keystone.service[81310]: Oct 13 04:17:34.077064 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] RBAC: Authorization granted {{(pid=81310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 04:17:34.135980 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a05ffcfed84dae95f090e6bfb59ba3', 'request_id': 'req-35b5e6b7-e1d0-494d-886d-168145154ff0'} {{(pid=81310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:34.141954 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a05ffcfed84dae95f090e6bfb59ba3', 'request_id': 'req-35b5e6b7-e1d0-494d-886d-168145154ff0'} {{(pid=81310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:34.155464 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a05ffcfed84dae95f090e6bfb59ba3', 'request_id': 'req-35b5e6b7-e1d0-494d-886d-168145154ff0'} {{(pid=81310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:34.182151 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] The token cache is being invalidate because project 78a05ffcfed84dae95f090e6bfb59ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 04:17:34.182773 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:34.182934 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG keystone.notifications [None req-35b5e6b7-e1d0-494d-886d-168145154ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 04:17:34.184257 dv-cinder-860997-1-smb devstack@keystone.service[81310]: [pid: 81310|app: 0|req: 597/1185] 10.222.0.13 () {58 vars in 1233 bytes} [Thu Oct 13 04:17:33 2022] DELETE /identity/v3/projects/78a05ffcfed84dae95f090e6bfb59ba3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 04:17:43.621905 dv-cinder-860997-1-smb devstack@keystone.service[81311]: DEBUG dbcounter [-] [81311] Writing DB stats keystone:SELECT=62 {{(pid=81311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 04:17:44.180091 dv-cinder-860997-1-smb devstack@keystone.service[81310]: DEBUG dbcounter [-] [81310] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}